-- Logs begin at Wed 2022-08-24 10:04:57 UTC, end at Wed 2022-08-24 11:09:57 UTC. -- Aug 24 10:28:30.177912 dv-cinder-854275-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 10:28:30.187202 dv-cinder-854275-3-smb devstack@keystone.service[81665]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 10:28:30 2022] *** Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: nodename: dv-cinder-854275-3-smb Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: machine: x86_64 Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: clock source: unix Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: pcre jit disabled Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: detected number of CPU cores: 4 Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: current working directory: / Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: detected binary path: /usr/bin/uwsgi-core Aug 24 10:28:30.189227 dv-cinder-854275-3-smb devstack@keystone.service[81665]: your processes number limit is 47680 Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: your memory page size is 4096 bytes Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: detected max file descriptor number: 2048 Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: lock engine: pthread robust mutexes Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: thunder lock: enabled Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 10:28:30.189813 dv-cinder-854275-3-smb devstack@keystone.service[81665]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 10:28:30.228664 dv-cinder-854275-3-smb devstack@keystone.service[81665]: Python main interpreter initialized at 0x564a108a39c0 Aug 24 10:28:30.228664 dv-cinder-854275-3-smb devstack@keystone.service[81665]: python threads support enabled Aug 24 10:28:30.228664 dv-cinder-854275-3-smb devstack@keystone.service[81665]: your server socket listen backlog is limited to 100 connections Aug 24 10:28:30.228664 dv-cinder-854275-3-smb devstack@keystone.service[81665]: your mercy for graceful operations on workers is 90 seconds Aug 24 10:28:30.229033 dv-cinder-854275-3-smb devstack@keystone.service[81665]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 10:28:30.229108 dv-cinder-854275-3-smb devstack@keystone.service[81665]: *** Operational MODE: preforking *** Aug 24 10:28:30.229363 dv-cinder-854275-3-smb devstack@keystone.service[81665]: *** uWSGI is running in multiple interpreter mode *** Aug 24 10:28:30.229363 dv-cinder-854275-3-smb devstack@keystone.service[81665]: spawned uWSGI master process (pid: 81665) Aug 24 10:28:30.229569 dv-cinder-854275-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 10:28:30.231772 dv-cinder-854275-3-smb devstack@keystone.service[81665]: spawned uWSGI worker 1 (pid: 81676, cores: 1) Aug 24 10:28:30.231772 dv-cinder-854275-3-smb devstack@keystone.service[81665]: spawned uWSGI worker 2 (pid: 81677, cores: 1) Aug 24 10:28:30.231772 dv-cinder-854275-3-smb devstack@keystone.service[81665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 10:28:34.544433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:28:34.544433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Aug 24 10:28:34.545282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:28:34.545282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: from cryptography.utils import int_from_bytes Aug 24 10:28:34.549746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:28:34.549746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: from cryptography.utils import int_from_bytes Aug 24 10:28:34.550323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 10:28:34.550323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: from cryptography.utils import int_from_bytes Aug 24 10:28:34.594636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:28:34.594850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:28:34.595005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] command line args: [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:28:34.595274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:28:34.595451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ================================================================================ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:28:34.595708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.595830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 10:28:34.595946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 10:28:34.596068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_dir = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.596178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.596299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] command line args: [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 10:28:34.596428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] config_source = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.596550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 10:28:34.596673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] debug = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.596782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ================================================================================ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 10:28:34.596893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] admin_token = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_dir = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_source = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.597894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] debug = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_config_append = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_dir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.598913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_config_append = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.599988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.600196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_dir = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.600196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.600615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.600615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.600902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.601943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.602878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.603487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.603666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.603666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.603943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] publish_errors = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.604888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.605888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] publish_errors = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] standard_threads = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.606855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_journal = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] standard_threads = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_json = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_stderr = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] use_syslog = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.607926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_journal = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.608512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_json = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.608765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_stderr = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_syslog = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.608989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 10:28:34.609226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.609934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.610896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.611985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.612916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.613908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.614908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.615931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.616902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.617935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.618905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619591 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.619943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.620903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.621985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.622928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.623847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.624922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.625977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.626937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.627960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.628914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.629925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.630915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.631950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.632958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.633882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.634963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.external = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.635879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.external = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.password = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] auth.token = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.636959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.password = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.token = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.637911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.638883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.639798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.640973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.641919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.642917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.643885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.644962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.645966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.646987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.647856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.648990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.649111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.649232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.649352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.649473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.649594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.650960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.651904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.652977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.653937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.654935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.655883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.656977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.657939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.658929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.659891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.660965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.661933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.662987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.663965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.664943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.665064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.665183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.665336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.665991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.666906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.667992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.668801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.669898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.670999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.671930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.672982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.673953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.674947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.675887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.676987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.677834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.678915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.679919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.680905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.681882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.682963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.683935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.684931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.685887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.686980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.687960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:28:34.688671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 10:28:34.688671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 10:28:34.710130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.710385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.710541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.713714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.714129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.714512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.719884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.726141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.749213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.749434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.754383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.754620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.804697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.804859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.855008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.855241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.855668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.855904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.923100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.923347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.923573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.923891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.924193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.924415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.952950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.953192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.953386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.953604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.953816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.954027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.954269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:34.966714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.010523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.010761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.010985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.011205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.011424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.011644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.025412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.025637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.025862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.026107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.026332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.026546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.026756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.034958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.048443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.048669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.048889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.049105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.049317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.049529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.049740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.061264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.061416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.061638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.061852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.062083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.062296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.062508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 10:28:35.067542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.067751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:28:35.068098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.068298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:28:35.068580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.068843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.069366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.069630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.072599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.072803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:28:35.073138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.073336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 10:28:35.073609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.073870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.074149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.074406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.078970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.079248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.079521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.079809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.083768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.084049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.084317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.084599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.086770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.089676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.089965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.090286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.090571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.090855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.091118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.091391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.091482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.091665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.092052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.092329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.092599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.094358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.094644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.094925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.095210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.095492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.095750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.096016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.096285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.096554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.096825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.097089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.115627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.117085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.117372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.120408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.121864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.122169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.122718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.123003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.123286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.126646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.126933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.127213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.129659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.129930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.133601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.133889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.134088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.134391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.134689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.134974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.135252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.135549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.135820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.136101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.137841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.138159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.138443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.138725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.139116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.139394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.139668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.139937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.153429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.153709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.155698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.155990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.157565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.159811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.160779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.161075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.162879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.163188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.165776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.167994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.168935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.171117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.172179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.172480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.172769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.173068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.173359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.173648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.174219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.174532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.174819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.175222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.175503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.175780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.189923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.190260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.190530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.190791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.192052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.192343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.192610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.192883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.197636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.199192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.199470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.199558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.202122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.202412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.202497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.202696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.202788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.203001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.203289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.205353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.205648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.205942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.206260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.206543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.215017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.215299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.215581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.215859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.216141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.216418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.216696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.218123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.218410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.218690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.218970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.219250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.219531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.219807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.232515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.235563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.235655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.238451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.238541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.239871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.241331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.241415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.241629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.241919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.242852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.244342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.244635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.244916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.248391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.249841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.251319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.252755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.252880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.253049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.253330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.253611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.255673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.255964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.256260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.256548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.261523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.261817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.262118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.264574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.264865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.265145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.268937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.269223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.269507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.269782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.270080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.270370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.270646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.270915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.271193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.271473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.271753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.271842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 10:28:35.272015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.272224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.272306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.272506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.272587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.272784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.273313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.273598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.273884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.274191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.274482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.275278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.275550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.275813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.276087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.276346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 10:28:35.307748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564a108a39c0 pid: 81676 (default app) Aug 24 10:28:35.309246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564a108a39c0 pid: 81677 (default app) Aug 24 10:28:35.311200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504cf8-891a-4462-94d6-5f02e3e6f463 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:35.311527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504cf8-891a-4462-94d6-5f02e3e6f463 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:35.311752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec504cf8-891a-4462-94d6-5f02e3e6f463 None None] PATH_INFO: `/v3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:35.315920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Wed Aug 24 10:28:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:41.940654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:41.941205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:41.941205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:41.945452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:28:41.952123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:41.952537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:41.952659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:42.023028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: INFO dbcounter [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] Registered counter for database keystone Aug 24 10:28:42.043317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG oslo_db.sqlalchemy.engines [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:28:42.049456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writer thread running {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:28:42.226946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81676) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:28:42.227354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG passlib.handlers.bcrypt [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81676) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:28:42.281791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:42.283410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:42.409555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 10:28:42.882037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:42.951908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: INFO dbcounter [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] Registered counter for database keystone Aug 24 10:28:42.973332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG oslo_db.sqlalchemy.engines [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 10:28:42.979977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writer thread running {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 10:28:43.101201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6064a-bc5d-4526-be8b-9a514a96ec2f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:43.105336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:43.105954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:43.106262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:43.106535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:43.114515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:43.164295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:28:43.164630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2300f4-d08d-41b7-87ab-543af6462a97 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:43.173901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Aug 24 10:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:28:43.179889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:43.194145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cb44a-fdce-4b29-ad8b-fba7269cb377 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:43.199067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:43.200174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:43.200454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:43.200723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] PATH_INFO: `/v3/projects/4732e69892d041d9ae3567e9b16b15ff` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:43.202334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] RBAC: Authorizing `identity:get_project(project_id=4732e69892d041d9ae3567e9b16b15ff)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:43.253842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 10:28:43.254221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efa5eb-3f0a-4eb9-8f31-fc8f28526523 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:43.260191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Wed Aug 24 10:28:43 2022] GET /identity/v3/projects/4732e69892d041d9ae3567e9b16b15ff => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:45.171029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a20f8-e6b4-4555-9393-eea3f797850f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:45.171551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a20f8-e6b4-4555-9393-eea3f797850f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:45.171644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a20f8-e6b4-4555-9393-eea3f797850f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:45.175715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:28:45.181019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:45.181433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:45.181555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:45.201195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:45.202735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:45.210436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 10:28:45.479857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a20f8-e6b4-4555-9393-eea3f797850f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:45.491770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a20f8-e6b4-4555-9393-eea3f797850f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:45.495967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:45.496566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:45.496848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:45.497125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:45.504733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:45.506539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03098-56b2-472a-87fa-bcc73cf82caa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:45.515777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Wed Aug 24 10:28:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:28:45.521330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:45.531448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99d597-16e3-4b46-8560-36bf5036cc84 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:45.535944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:45.536562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:45.536840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:45.537108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:45.538446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:45.540280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee92e8-696a-4c3b-9990-60d561d9ef57 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:45.541829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Wed Aug 24 10:28:45 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:47.522839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6287fd-63a9-4b5c-87ac-422e69adf48b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.523653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6287fd-63a9-4b5c-87ac-422e69adf48b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.523743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6287fd-63a9-4b5c-87ac-422e69adf48b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.525029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:47.530636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.531054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.531243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.549888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:47.551076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:47.559296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f8c6-3562-46e4-8e10-00aa81784149 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.559586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f8c6-3562-46e4-8e10-00aa81784149 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.559864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504f8c6-3562-46e4-8e10-00aa81784149 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.561188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:28:47.566502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:47.566792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:47.567074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:47.610566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG passlib.handlers.bcrypt [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81677) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 10:28:47.610988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG passlib.handlers.bcrypt [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81677) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 10:28:47.629992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:47.657123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:47.658744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:47.757135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:28:47.920951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:47.945124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.031013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b9b29-266c-4e91-a34e-6843dcdf5555 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.032802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.064831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.065459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.065738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.066017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.078145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:48.086643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:48.087556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:28:48.088392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:48.093417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.136809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad89ab-19a8-4841-9b33-916d0d267192 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.139767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.174766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.175626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.175910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.176184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.176798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.195052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80646be-45f1-41cf-9ef1-0ba942fa0381 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.227980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.228581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.228863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.229130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.229793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:48.230115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.231518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.243155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:48.244110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.245715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.249183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.348358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc953-5b20-4b48-95ed-cb7c3588bfc3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.348540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:28:48.354364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.357234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.382905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.383539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.383818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.384630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.385761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.387265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.388834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:48.394333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.408693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.453478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae4f1-fff0-4e14-9044-13cadba66c61 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.487317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.488169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.488450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.488724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.495424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9d7b0-7c49-4a43-a17e-84158b4cf4c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.506832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.508311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:48.527965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:48.529309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:48.530606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:48.530606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:48.530606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:28:48.530606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:48.530826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.530826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.531246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.531413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.532459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.534317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.534867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.535865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:48.541963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:48.591040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.622126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:48.635860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef84c-fb53-4f5f-8d45-a96b8d73a42d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.641684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897d4df-8c28-4675-8606-a0ca289eccbc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:48.677396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.678024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.678342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.678621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.679285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:48.679602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.681542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765b88-9dcc-4b68-afe0-adcd73af8c49 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.688038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:48.688647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:48.688926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:48.689198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:48.689925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.domain.id=default, user.id=db44673f0e0b4e638e97d470584da9c7) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:48.690266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:48.691707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69d07-4d05-40a9-ae05-20880b5083c8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:48.699165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/role_assignments?user.id=db44673f0e0b4e638e97d470584da9c7&scope.domain.id=default&role.id=88421fc218124abeb809266ecb9668ea => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:48.700251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:50.761120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe488d4-b59c-4d93-b360-962a6a0c697d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.761630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe488d4-b59c-4d93-b360-962a6a0c697d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.761630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe488d4-b59c-4d93-b360-962a6a0c697d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.763018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:50.779915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0493-e50c-4b3c-bafe-d5b53473e7c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:50.780399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0493-e50c-4b3c-bafe-d5b53473e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:50.780474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f0493-e50c-4b3c-bafe-d5b53473e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:50.807503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-802f0493-e50c-4b3c-bafe-d5b53473e7c2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:50.808703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-802f0493-e50c-4b3c-bafe-d5b53473e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:50.904321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:51.149095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708244-8e78-4bed-9d92-de88f9c0d0f9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.149396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708244-8e78-4bed-9d92-de88f9c0d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.149799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e708244-8e78-4bed-9d92-de88f9c0d0f9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.151167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:51.156261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1eb83-8f64-4028-9eee-d24ac4368513 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.156553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1eb83-8f64-4028-9eee-d24ac4368513 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.156832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1eb83-8f64-4028-9eee-d24ac4368513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.183058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-71d1eb83-8f64-4028-9eee-d24ac4368513 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:51.184249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-71d1eb83-8f64-4028-9eee-d24ac4368513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:51.240256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.273030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:51.339381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460630a7-f5ff-4ec8-a425-8da78b59fce1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.339673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460630a7-f5ff-4ec8-a425-8da78b59fce1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.339932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460630a7-f5ff-4ec8-a425-8da78b59fce1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.341277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 14/26] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:51.346602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb1c1-fa1d-45fe-89d8-cbec16d9666b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.346888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb1c1-fa1d-45fe-89d8-cbec16d9666b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.347158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb1c1-fa1d-45fe-89d8-cbec16d9666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.371055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-779eb1c1-fa1d-45fe-89d8-cbec16d9666b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:51.372261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-779eb1c1-fa1d-45fe-89d8-cbec16d9666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:51.418657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460630a7-f5ff-4ec8-a425-8da78b59fce1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.466464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:51.467823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b869b6-ccb5-43fb-9bff-b1cc6dea92be None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.476811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b869b6-ccb5-43fb-9bff-b1cc6dea92be None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.477136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b869b6-ccb5-43fb-9bff-b1cc6dea92be None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.480695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 14/28] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:51.486867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.487150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.487479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.523104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:51.524704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:51.627710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:51.632372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.674878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460630a7-f5ff-4ec8-a425-8da78b59fce1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.711183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.742885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.744397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.744866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.745345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.772272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:51.778812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:51.779657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:51.780392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:28:51.782792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 15/30] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:51.788996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:51.794587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:51.892835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfc0d-078c-47a6-bfe4-8fa2988639a0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:51.936669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:51.937219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:51.937689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:51.938125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:51.949464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:51.951318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:28:51.966404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:51.967253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:28:51.968129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:28:51.968129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:28:51.968129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:28:51.969893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:28:51.970889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.017555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468186c-e467-426b-ac19-15bb5c659196 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.054997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.055986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.056267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.056536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.057202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:52.057502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.058938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.068169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 16/32] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:52.073744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.074512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.086625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e97008-6c4e-49d7-b7ba-fb2da04ef0f6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.124552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.125171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.125450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.125722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.126542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.127787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.160878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.201306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8a7e-68d6-4c0c-9d54-0cb06f1841dc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.247197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.248242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.248720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.249221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.250144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:52.250661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.252310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.271087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 17/33] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:52.272211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.288897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 17/34] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 24 10:28:51 2022] POST /identity/v3/roles => generated 219 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:28:52.294127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.473102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd1650-7faf-4907-a6db-290f96f13d00 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.496429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1822aa0-22ec-45e3-b35a-2d0475378825 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.511876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.524023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.525006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.525349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.525691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.526718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.528885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.539329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.540533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.541029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.541515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.543540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.545323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.547522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 18/35] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:28:52 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:52.548521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.570320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.678999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2e7ec-d80b-45a8-814b-7cab8366b425 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.694279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 18/36] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 24 10:28:52 2022] POST /identity/v3/roles => generated 225 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:28:52.695443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.726102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.726679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.726974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.727255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.728505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.731224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96985f-221e-4fcc-803e-7d6a5789fb64 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.765255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:28:52 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:28:52.766893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08774f2-a031-49a8-b76e-6f346745740a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.767264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08774f2-a031-49a8-b76e-6f346745740a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.767621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08774f2-a031-49a8-b76e-6f346745740a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.774346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 20/38] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:52.774346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2163-f3a6-4d9c-a77e-73b16e467f58 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.774346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2163-f3a6-4d9c-a77e-73b16e467f58 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.774346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2163-f3a6-4d9c-a77e-73b16e467f58 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.774346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 21/39] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:52.779964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533488d-c177-45b6-8873-e8b4b13a8a76 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.782680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533488d-c177-45b6-8873-e8b4b13a8a76 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.783197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533488d-c177-45b6-8873-e8b4b13a8a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.805166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7533488d-c177-45b6-8873-e8b4b13a8a76 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:52.807142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7533488d-c177-45b6-8873-e8b4b13a8a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:52.857796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d73d-4868-46fa-999d-a25c34662c64 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:52.906297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:52.906804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:52.907997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.908391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.908734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.910333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:52.911949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:52.913146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 22/40] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:52.913671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 19/41] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:52.918129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:52.918129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:52.918129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:52.921775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:52.937274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:52.939352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:53.010925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:53.036652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 23/42] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:28:53.061726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706277ce-bd4d-4e01-a2d7-76f5bc9e38d3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:53.100701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:53.101706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:53.102237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:53.102748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] PATH_INFO: `/v3/domains/default/users/db44673f0e0b4e638e97d470584da9c7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:53.104983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=db44673f0e0b4e638e97d470584da9c7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:53.106685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:53.121767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 20/43] 10.222.0.52 () {58 vars in 1361 bytes} [Wed Aug 24 10:28:52 2022] PUT /identity/v3/domains/default/users/db44673f0e0b4e638e97d470584da9c7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:28:53.209658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:53.310330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:53.328864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15dc48b-35b3-486e-af4c-aad5d9879381 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:53.360922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:53.370197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:53.370820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:53.371121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:53.371414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:53.372100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:53.373799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:53.390497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 24/44] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 24 10:28:53 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:28:53.423674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025153f-bf20-4cd8-912d-6c4037ffa0b7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:53.442604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:53.471048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:53.471756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:53.472037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:53.472308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:53.473478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:53.475153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916cd0e-042d-414d-a5e5-76b7d61cc6bc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:53.476933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 21/45] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:53.482550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:53.596611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708e4e-8423-40e2-925a-4fb6d09865a5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:53.630137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:53.630729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:53.631017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:53.631296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:53.631957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:53.633402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f631d65-0ff3-4cf3-8985-d4c1dbb7450f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:53.660452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 25/46] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:28:53 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:28:55.064519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab1bf-1fac-4bb6-b45e-29cc9bd40a05 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.065022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab1bf-1fac-4bb6-b45e-29cc9bd40a05 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.065103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ab1bf-1fac-4bb6-b45e-29cc9bd40a05 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.066600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 22/47] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:55.071757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ddd-eea8-44df-8b01-662fcc28580e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.072180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ddd-eea8-44df-8b01-662fcc28580e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.072311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ddd-eea8-44df-8b01-662fcc28580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.089939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-58da8ddd-eea8-44df-8b01-662fcc28580e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:55.091126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-58da8ddd-eea8-44df-8b01-662fcc28580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:55.126819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.159910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 26/48] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:28:55.427091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab1bf-1fac-4bb6-b45e-29cc9bd40a05 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.529267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ab1bf-1fac-4bb6-b45e-29cc9bd40a05 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.549819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf700d-965c-4254-9e56-113cdbbe7f4c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.550235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf700d-965c-4254-9e56-113cdbbe7f4c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.550580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf700d-965c-4254-9e56-113cdbbe7f4c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.551998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 27/49] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:28:55.557363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.557645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.557915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.562396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.563022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.563298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.563565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.575538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:55.575958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:28:55.576705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:28:55.580665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:28:55.581739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:28:55.582540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 23/50] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:28:55.587556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.631796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.642868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 28/51] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:28:55.809938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbf5e4-adfd-4521-b222-4017b58df183 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.846285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:55.846902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:55.847182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:55.847457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:55.848133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:55.848443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:55.849843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:55.858501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 24/52] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:55.863896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.926407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:55.958980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:55.961946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7bc2-1391-464f-9939-f5c51eee8248 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:55.999358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.000083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.000577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.000899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.002687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.004915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.006923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 29/53] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:56.012547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.027816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb317c-48ea-43ad-8b1a-6f4ecce68a60 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.030100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.062524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.063084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.063353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.063709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.065421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.068155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.071139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 25/54] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:56.077135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.113711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c65023-788a-4cb3-9d80-7e5514667db2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.149520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.150197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.150480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.150754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.151858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.153306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.154883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 30/55] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:56.160505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:56.179255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586cc9f-fc73-40fd-aa49-128debd93b1c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.195309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:56.215087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.215720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.216001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.216274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.216953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.218500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71ebe-e37b-4803-bd37-62152b6b926d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.249101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 26/56] 10.222.0.52 () {60 vars in 1140 bytes} [Wed Aug 24 10:28:56 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:28:56.371545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eef5-1408-4694-a1ff-7c179d9ef0b6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:56.408956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:56.409580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:56.409863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:56.410166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:56.410924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.domain.id=default, user.id=db44673f0e0b4e638e97d470584da9c7) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:28:56.411244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:56.412688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26db48d-bdc7-4194-b984-cc8774f80d5e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:56.421762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 31/57] 10.222.0.52 () {56 vars in 1322 bytes} [Wed Aug 24 10:28:56 2022] GET /identity/v3/role_assignments?user.id=db44673f0e0b4e638e97d470584da9c7&scope.domain.id=default&role.id=88421fc218124abeb809266ecb9668ea => generated 530 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:28:58.164912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6d1d-b2c0-4fb1-82d6-c27316cfef7c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.165903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6d1d-b2c0-4fb1-82d6-c27316cfef7c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.166018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6d1d-b2c0-4fb1-82d6-c27316cfef7c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.167370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 27/58] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:28:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:28:58.172547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.172997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.173107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.191102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:28:58.192318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:28:58.256347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 32/59] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:28:58.526134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6d1d-b2c0-4fb1-82d6-c27316cfef7c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:58.552039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:58.626544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6d1d-b2c0-4fb1-82d6-c27316cfef7c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:58.659942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:58.660561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.660841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.661112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.662258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:58.663712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77070-a756-4d4f-b86c-b9c9f4573236 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:58.665314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 28/60] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:28:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:28:58.671364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:28:58.699526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:28:58.766349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7f48f-5b1f-4572-aff0-988b1e5e8c1f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:28:58.799253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:28:58.799790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:28:58.800070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:28:58.800345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:28:58.800990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:28:58.802452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d3f2b-2ed2-4a2e-9668-c996757b07d8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:28:58.828962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:28:58 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:01.638314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe308-9511-4f3e-89ff-8c95636d3c79 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.639285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe308-9511-4f3e-89ff-8c95636d3c79 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.639759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe308-9511-4f3e-89ff-8c95636d3c79 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.641568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 29/62] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:01.646774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f384-f7ba-403c-8e7a-6f3e293b3a2b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.647577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f384-f7ba-403c-8e7a-6f3e293b3a2b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.648071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f384-f7ba-403c-8e7a-6f3e293b3a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.669998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4362f384-f7ba-403c-8e7a-6f3e293b3a2b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:01.671546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4362f384-f7ba-403c-8e7a-6f3e293b3a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:01.768493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:01.887480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071295b0-f85f-4c86-80f6-7dcb735b6d00 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.888098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071295b0-f85f-4c86-80f6-7dcb735b6d00 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.888634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071295b0-f85f-4c86-80f6-7dcb735b6d00 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.890349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 30/64] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:01.895700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913201-585e-48a7-b11a-9735e80abd44 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:01.895994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913201-585e-48a7-b11a-9735e80abd44 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:01.896280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b913201-585e-48a7-b11a-9735e80abd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:01.921354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8b913201-585e-48a7-b11a-9735e80abd44 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:01.922582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8b913201-585e-48a7-b11a-9735e80abd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:01.933793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.012584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 35/65] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:02.094822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071295b0-f85f-4c86-80f6-7dcb735b6d00 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.172891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049cb-81e9-429d-9605-765923c004cf None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.173495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049cb-81e9-429d-9605-765923c004cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.173972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049cb-81e9-429d-9605-765923c004cf None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.175808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 36/66] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:02.181626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316290c2-798b-4fee-8916-1848deb61749 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.182185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316290c2-798b-4fee-8916-1848deb61749 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.182673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316290c2-798b-4fee-8916-1848deb61749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.223003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071295b0-f85f-4c86-80f6-7dcb735b6d00 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.226921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.227265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-316290c2-798b-4fee-8916-1848deb61749 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:02.228547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-316290c2-798b-4fee-8916-1848deb61749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:02.284806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.285439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.285749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.286052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.311521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:02.319210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:02.320136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:02.320889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:02.322610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 31/67] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:02.328651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.360137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 37/68] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:02.361423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316290c2-798b-4fee-8916-1848deb61749 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.485867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160d583-af50-487d-8d13-63046c9f180a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.520263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.557226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.558095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316290c2-798b-4fee-8916-1848deb61749 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.558248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.558375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.558841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.559682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:02.560241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:02.561921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a2ed0-8338-41c8-a6c9-5997c7690ffe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:02.570887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 32/69] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:02.572541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057247a-938d-4be7-bff3-925dbee32afc None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.573005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057247a-938d-4be7-bff3-925dbee32afc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.573563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057247a-938d-4be7-bff3-925dbee32afc None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.579072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 33/70] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:02.580156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057247a-938d-4be7-bff3-925dbee32afc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.595099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db548315-7dca-44ba-b688-994b27763348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.595801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db548315-7dca-44ba-b688-994b27763348 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.596083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db548315-7dca-44ba-b688-994b27763348 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.596358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db548315-7dca-44ba-b688-994b27763348 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.598197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.611042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db548315-7dca-44ba-b688-994b27763348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-db548315-7dca-44ba-b688-994b27763348 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:02.617521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:02.618494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:02.619800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 38/71] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:02.620430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b266-2325-446a-b3ed-7509dccb7a53 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.622263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b266-2325-446a-b3ed-7509dccb7a53 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.622263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57b266-2325-446a-b3ed-7509dccb7a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.639411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8a57b266-2325-446a-b3ed-7509dccb7a53 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:02.640607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8a57b266-2325-446a-b3ed-7509dccb7a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:02.693392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057247a-938d-4be7-bff3-925dbee32afc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.707959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 39/72] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:02.709226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee15f-f093-4997-ac20-ae260914ff70 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.709507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee15f-f093-4997-ac20-ae260914ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.709791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee15f-f093-4997-ac20-ae260914ff70 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.711346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 40/73] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:02.711838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee15f-f093-4997-ac20-ae260914ff70 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.735295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.735987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.736211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.736482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.737637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:02.739134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:02.740717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 34/74] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:02.741487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.786523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.826435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee15f-f093-4997-ac20-ae260914ff70 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.840322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:02.864649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616460a0-cd2e-4c3b-9418-294a4e8fd03e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:02.865601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.866405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.866688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.867749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.868430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:02.868745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:02.870205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f3eba-5f5b-4a32-b8dd-991c2a961443 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:02.883825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 41/75] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:02.887333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.887625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.887900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.906146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:02.907358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:02.908082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:02.908947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:02.909414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:02.909885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:02.920582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:02.925978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:02.926857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:02.927597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:02.929602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 35/76] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:02.930658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:02.983334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 42/77] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:02.991064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.043649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd40ec-30f8-45f8-850a-035a5e42733a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.054160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.082783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.083385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.083663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.083946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.098088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e881050-8d84-4eda-93fa-dcef8a4d7ca2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.098312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.137060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.137927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.138396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.138679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.155388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.156858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.158795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 43/78] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.159282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.166269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.266283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730d36-73d5-42cd-b357-5e90a1647695 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.269484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 36/79] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:03.270363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.283509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.302257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.302871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.303166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.303426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.304098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:03.304452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.305778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.314044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 44/80] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.314985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.318905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.375143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a09e7-c070-42e9-8703-893082babed0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.410320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.410945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.411227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.411501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.418688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd6039-154c-4eca-9fa7-20c978bf6231 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.422752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:03.427512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:03.428409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:03.429199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 37/81] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:03.429840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.454358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.454976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.455261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.455536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.499923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.522789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.524466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.532637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c6de0-827e-49c7-849e-2f35d5325936 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.534196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.567876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.568504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.568786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.569059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.570208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.572178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.573764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 38/82] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.574566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.627639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 45/83] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:03.628334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.677193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b21765-00e0-420b-9f92-303a82f542aa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.705482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.715578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.716256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.716574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.716850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.718001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.719483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.721121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 39/84] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.721948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.733770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605fe5e-5324-48c0-8e5b-f052ab04d881 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.762251 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:03.768751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.769388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.769672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.769951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.771111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.772669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.774593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 46/85] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.778753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.826029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8fd28-82cb-474e-bb5e-bac41d282740 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.861644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.862283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.862562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.862833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.863499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:03.863801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.865178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.873573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 40/86] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:03.874384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.877567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86927cf8-59a0-429a-a2cc-3456f85bda9d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:03.911978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:03.912589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:03.912876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:03.913155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:03.913812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:03.915303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:03.936372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 47/87] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:03 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:03.937042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:03.939589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.002776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.006451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f3cb-dff6-4c4f-86f5-dd9b7e3b2777 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.047904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.048463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.048744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.049017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.050276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.051790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.053493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 41/88] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.054318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.068973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a5e00-f165-4738-835f-9f3d6f4efcb1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.112817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.113437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.113758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.114166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.114955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=db44673f0e0b4e638e97d470584da9c7) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:04.115265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.116732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.123590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 48/89] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:03 2022] GET /identity/v3/role_assignments?user.id=db44673f0e0b4e638e97d470584da9c7&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.124651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.189674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb587b-bfc7-413c-98b1-1e43f5824935 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.236247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.246208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.246975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.247347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.247631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.285357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d7472-b5d9-4946-a0af-cb31e98b6bac None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.297721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.329617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.330230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.330521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.330805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.332093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.333697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.335974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 49/90] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.336792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.349450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.351043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.466479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5906-2b2e-4f49-9867-67f7e703f990 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.519753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.520395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.520681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.520965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.521704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=397a24e018744894addac09d82911043) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:04.522020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.523755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.526656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.536183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 50/91] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:04.537112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.565499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 42/92] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:04.571168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.664734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:04.704160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea01ede-2561-48b8-b25f-491a70bf3c9c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.769749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.770526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.770735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.771294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.772483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.774451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.777392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 43/93] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:04.783378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:04.795452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5965f4-5489-45a4-a1a1-ca0b73ad16ff None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.880155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.880864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.881316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.881455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.902176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcf682-0b4e-4794-b408-b5f236558e24 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:04.941523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:04.942511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:04.942990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:04.943401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:04.944407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=397a24e018744894addac09d82911043) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:04.944871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:04.946514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:04.953155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 44/94] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:04.953734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.025165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.028856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.030457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.176357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 51/95] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:05.183941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.300911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefcda-022f-4ba8-872d-5659e78d496a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.337762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.338826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.339309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.339815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] PATH_INFO: `/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.341259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] RBAC: Authorizing `identity:get_project(project_id=a2799ee54f6b4d1abfe30c1e85171c24)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.342976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a402-240b-44d0-8a09-b60008a418fc None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.344878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 45/96] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:05.350867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:05.528443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:05.536243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7b149-40bb-4090-b1de-0465a3696336 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:05.597204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:05.598500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:05.599181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:05.599905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:05.601216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=a2799ee54f6b4d1abfe30c1e85171c24, user.id=397a24e018744894addac09d82911043) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:05.601931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:05.604964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a98324-4773-43e3-a16a-a124101cab75 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:05.614527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 52/97] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:05 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=a2799ee54f6b4d1abfe30c1e85171c24&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:06.764552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424766e-8a6f-40f8-9889-16dea5d0e8b2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.765062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424766e-8a6f-40f8-9889-16dea5d0e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.765134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424766e-8a6f-40f8-9889-16dea5d0e8b2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.766488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 46/98] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:06.771798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400389e4-f715-45c7-b9d3-fda224eeace4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.772260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400389e4-f715-45c7-b9d3-fda224eeace4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.772449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400389e4-f715-45c7-b9d3-fda224eeace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.796053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-400389e4-f715-45c7-b9d3-fda224eeace4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:06.797264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-400389e4-f715-45c7-b9d3-fda224eeace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:06.881364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 53/99] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:06.957478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b1a0-4c8a-48cc-8441-30ac098398a7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.958128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b1a0-4c8a-48cc-8441-30ac098398a7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.958626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b1a0-4c8a-48cc-8441-30ac098398a7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.960198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 47/100] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:06.965678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:06.965975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:06.966296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:06.987991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:06.989250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:07.033120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59f14-1b9f-4c43-a86a-e9d545b2cd49 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.033702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59f14-1b9f-4c43-a86a-e9d545b2cd49 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.034218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a59f14-1b9f-4c43-a86a-e9d545b2cd49 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.035779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 48/101] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:07.041422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.041947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.042481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.068606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 54/102] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:07.073482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:07.075059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:07.139643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:07.149039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:07.415214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:07.441258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:07.444151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:07.573145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501c83a-ff23-40e2-a984-9bc8260d41a3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:07.610800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:07.611806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.612287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.612757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.625467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:07.630989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:07.631941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:07.632735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:07.636308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 55/104] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:07.637340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:07.730682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:07.746312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6eb79-15b0-4e1e-8f09-1b1830112976 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:07.747899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7928c-5b2e-40be-9d8a-c9c24493a895 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:07.789257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:07.789872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:07.789872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.791004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.791004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.792040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.792523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.793141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.795081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:07.797045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:07.799329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 56/105] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:07.800346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:07.801663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-05ea7df6-c5f6-4cf4-8747-1d049b2d719e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:07.808350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:07.809248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:07.810347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 50/106] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:07.811137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731723-9d03-44f2-8459-dcbcd90a34e4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.811137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731723-9d03-44f2-8459-dcbcd90a34e4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.811283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731723-9d03-44f2-8459-dcbcd90a34e4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.813143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 51/107] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:07.813861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731723-9d03-44f2-8459-dcbcd90a34e4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:07.882760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:07.928895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65c0b6-c21a-4148-956a-dd651956f9d5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:07.929384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731723-9d03-44f2-8459-dcbcd90a34e4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:07.966912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:07.967234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:07.967530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.967758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.967855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.968036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.968130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.968307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.968735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:07.968999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:07.969092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:07.970438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3e1ed-d8d7-4ba5-9f3c-98cb0c4e65f0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:07.970595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 57/108] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96848c-d97b-4c3f-9903-b5dbecc67268 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96848c-d97b-4c3f-9903-b5dbecc67268 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96848c-d97b-4c3f-9903-b5dbecc67268 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 58/109] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:07.979339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:07.984316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.002804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:08.003986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:08.010369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 52/110] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:29:07 2022] POST /identity/v3/projects => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:08.010369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.017706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.106523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 59/111] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:08.107700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.157144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431e12f-3757-4f90-b9e2-8f4494e10e63 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.178603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.207165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.207782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.208107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.208381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.209204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:08.209515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.211004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc374d0-ab98-4d4e-aa42-8ec7ded2f88e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:08.225699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 53/112] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:08.225699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.225699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.225699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.235966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213c31-bd75-4411-b663-95ff0792f3d1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.244048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:08.244888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:08.271713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.272597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.273022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.273688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.275523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.277116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:08.278969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 60/113] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:08.280025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.292798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.318113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 54/114] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:08.318113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.430551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f1724-03cf-42e2-b0fc-8f35be6eb307 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.458445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.469649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.470622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.470906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.471176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.472296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.473745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:08.474531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18807a-fab7-44f9-b875-1bc6a4df6631 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.475411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 55/115] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:08.476180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.514501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.515068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.515352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.515629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] PATH_INFO: `/v3/users/9cecdb078d514c1c90b41d86e7c9eae7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.529934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] RBAC: Authorizing `identity:get_user(user_id=9cecdb078d514c1c90b41d86e7c9eae7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.531517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:08.533191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 61/116] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/users/9cecdb078d514c1c90b41d86e7c9eae7 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:08.533941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.603678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.622303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0e36-ff4e-41eb-a6e8-ae972c0e99c7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.640171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b6679-1711-4a81-a7c7-4c5a30da4083 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.669024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.669659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.669936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.670263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.684768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:08.686318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.687234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.687711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.688198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/db44673f0e0b4e638e97d470584da9c7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:08.690146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:08.690968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 56/117] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:08.692202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.693619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, user_id=db44673f0e0b4e638e97d470584da9c7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.695481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:08.712679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 62/118] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:08 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/db44673f0e0b4e638e97d470584da9c7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:08.714575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.735237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.843880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e8106-d3a2-4c1a-bc59-b23559cd1255 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.856263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9083af-85dc-4938-a939-1b939ff1ee81 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:08.888352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:08.888630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.889853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.890333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.890782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.902623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:08.903494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:08.903843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:08.904248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:08.917004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:08.922319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:08.923189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:08.923944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 63/119] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:08.924594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:08.988727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:08.990477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15f87d-a45e-4d58-97ee-16b1fa348440 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.030487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.062332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7c48f-0dd4-4439-978a-db6a3470f682 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.101304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 57/120] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:09.102997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c8c-d7de-46fe-8600-0f28b402b54a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.103462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c8c-d7de-46fe-8600-0f28b402b54a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.104465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c8c-d7de-46fe-8600-0f28b402b54a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.105926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 58/121] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:09.106854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c8c-d7de-46fe-8600-0f28b402b54a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.110918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.111863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.112216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.112569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.114234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.114623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.116119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.126828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 64/122] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.127649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.186626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.224155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c8c-d7de-46fe-8600-0f28b402b54a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.244133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bdc6c-cbec-413b-8d80-0b348856872f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.256178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.263376 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.264051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.264335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.264609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.265276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.265581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.267353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8696e5-948a-49cc-98c6-ee1e4c59de0c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.281369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 59/123] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.281369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.281369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.281369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.287763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.288585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.289102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.289577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.291509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.293152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.295163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 65/124] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.296323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.301016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:09.301615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:09.376869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 60/125] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:09.377743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.403158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf9d71-d041-4c09-9684-7772d17e198f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.421460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.441929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.442933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.443408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.443897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.445227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.447448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.449206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 66/126] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.450431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.498784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11df2b-a359-47f4-89c6-b870556b1670 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.526012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.539776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.540438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.540716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.540994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.542250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.543683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.550026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 61/127] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.550026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.569857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf8ef5-8083-4a04-94a9-331ddaea82c9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.610380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.611002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.611285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.611563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.612296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=9cecdb078d514c1c90b41d86e7c9eae7) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:09.612605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.614081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.619944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 67/128] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/role_assignments?user.id=9cecdb078d514c1c90b41d86e7c9eae7&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=8b89535bd4944575b5d404e140836fd6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.620553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.674506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976be416-20de-4f7a-bedf-6b6fdd453820 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.676279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.726457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.727545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.728106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.728598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.730912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.733272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.736682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 62/129] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.741795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ece756-9e86-4b8f-b75b-ef24c9389ecd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.742267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.784460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.785451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.785817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.786224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.788198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.789783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.792743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 68/130] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:09.808734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.827604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:09.890479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2099-90d4-4bc3-a792-d894a4bc5d89 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.929134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:09.929716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:09.930001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:09.930302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/397a24e018744894addac09d82911043/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:09.934350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, user_id=397a24e018744894addac09d82911043, role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:09.935805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:09.953493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70e28e-8494-44dc-a37a-9019a1051afa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:09.958282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 63/131] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:09 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/397a24e018744894addac09d82911043/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:09.959193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:09.976679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.000765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.001538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.001884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.002293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/397a24e018744894addac09d82911043/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.011907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, user_id=397a24e018744894addac09d82911043, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.013391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.045120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 69/132] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:09 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/397a24e018744894addac09d82911043/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:10.086130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba94759-9c77-48f1-823a-b64d465b800f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.106830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.126614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.127426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.127972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.128246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.140666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:10.145607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:10.148049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:10.150873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 64/133] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:10.158101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.314032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c73317-f84a-4b66-bc9b-78fa6f8aecd6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.360308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.360934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.361218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.361498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.362203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:10.362514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.363894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.377904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 70/134] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:10.383814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.507513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180771e-cbdc-4078-9463-22dd58c42c2f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.558782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.559424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.559700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.559969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.561142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.562610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41486583-5e5a-4928-bd81-af4f9f3fe7aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.564569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 65/135] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:10.569775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.579779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94118f2-eafc-4765-8508-91642a7bd2bd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.580051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94118f2-eafc-4765-8508-91642a7bd2bd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.580320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94118f2-eafc-4765-8508-91642a7bd2bd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.581655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 66/136] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:10.589343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.589617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.589884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.630420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:10.631624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:10.656165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.722435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e410f08-97cd-4fd0-a8a8-9e5e6c689d0b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.734295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.759045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.759927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.760343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.760539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] PATH_INFO: `/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.761555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] RBAC: Authorizing `identity:get_project(project_id=a2799ee54f6b4d1abfe30c1e85171c24)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.763365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.765332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 71/137] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:10 2022] GET /identity/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:10.771586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:10.810115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 67/138] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:10.875800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7ce8-e4db-4dc1-97f3-b4ae58866749 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:10.893540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:10.912037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:10.912711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:10.912996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:10.913278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] PATH_INFO: `/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24/users/397a24e018744894addac09d82911043/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:10.915210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] RBAC: Authorizing `identity:create_grant(project_id=a2799ee54f6b4d1abfe30c1e85171c24, user_id=397a24e018744894addac09d82911043, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:10.916686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:10.940011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 72/139] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:10 2022] PUT /identity/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24/users/397a24e018744894addac09d82911043/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:29:11.133161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:11.266369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067bf67-dab3-44f8-8244-22935d2b599c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:11.303802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:11.304434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:11.304708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:11.304974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:11.306615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:11.308063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c51dc0-b131-4f10-9b4f-13c98bc9a55d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:11.309797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 68/140] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:11.315114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:11.448317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5b5c5-2d62-4ce5-95d8-4cbe879cc35e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:11.483113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:11.483728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:11.484012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:11.484291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:11.484955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:11.486447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddebb70-de78-44ad-96e8-b4bb83688174 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:11.511690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 73/141] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:11 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:11.728288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc733ab-cd09-4cbc-8e5b-af3b9621d93a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:11.728724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc733ab-cd09-4cbc-8e5b-af3b9621d93a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:11.728724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc733ab-cd09-4cbc-8e5b-af3b9621d93a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:11.730105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 69/142] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:11.735955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97d9f-2866-4676-971e-68eb48d30a61 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:11.736243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97d9f-2866-4676-971e-68eb48d30a61 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:11.736528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97d9f-2866-4676-971e-68eb48d30a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:11.760124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-43b97d9f-2866-4676-971e-68eb48d30a61 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:11.761326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43b97d9f-2866-4676-971e-68eb48d30a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:11.783732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:11.846268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 74/143] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:12.184139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc733ab-cd09-4cbc-8e5b-af3b9621d93a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:12.245945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:12.315337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc733ab-cd09-4cbc-8e5b-af3b9621d93a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:12.355892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04194-218b-40fb-9a19-a16e4a2b7177 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.357064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04194-218b-40fb-9a19-a16e4a2b7177 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.357827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04194-218b-40fb-9a19-a16e4a2b7177 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.359493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 75/144] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:12.361541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:12.362199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.362541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.362816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.373399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.374178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.374676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.378682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:12.383431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:12.384892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:12.385777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 70/145] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:12.391940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:12.416547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:12.417763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:12.545787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217324c-d69c-4589-8e93-f908d879d3b6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:12.549304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:12.560409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 76/146] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:12.585153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:12.585778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.586057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.586360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.587046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:12.587418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:12.589354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:12.599138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 71/147] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:12.604603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:12.705075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:12.729400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36a85c-f062-4454-8135-8fb273d8117b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:12.770971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:12.771984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.772456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.772918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] PATH_INFO: `/v3/users/db44673f0e0b4e638e97d470584da9c7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:12.778918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] RBAC: Authorizing `identity:get_user(user_id=db44673f0e0b4e638e97d470584da9c7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:12.780618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:12.782474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 77/148] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:12 2022] GET /identity/v3/users/db44673f0e0b4e638e97d470584da9c7 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:12.788328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:12.942173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052675d-b810-453d-8b2a-8c41b4aed887 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:12.988564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:12.989174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:12.989459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:12.989731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.031150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.067544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.069006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.177620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 72/149] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:13.183222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.254163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.327997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba84650-fd8c-4dd0-b2cc-59791390f8bb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.342762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.400517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470bdc0-ca50-4bae-8362-5bcb7d1bc200 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.430537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.432276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.432699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.433126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.434587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.437679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.445997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 78/150] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:13.447805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.486711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.487615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.488236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.489516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.495944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.514295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:13.520829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:13.521860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:13.522793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:13.528534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 73/151] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:13.539521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.638397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ebd0c-27bc-4db1-b6da-3c445f3103e0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.683801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.684660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.685080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.685489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.686401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=db44673f0e0b4e638e97d470584da9c7) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:13.686845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.688444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e176e2b-e735-453c-8cdb-ac835f29c369 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.701717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 79/152] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/role_assignments?user.id=db44673f0e0b4e638e97d470584da9c7&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:13.703202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7941ff-6c5e-4a2f-8bee-72b85f546646 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.703643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7941ff-6c5e-4a2f-8bee-72b85f546646 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.704066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7941ff-6c5e-4a2f-8bee-72b85f546646 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.705683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 80/153] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:13.707017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9de7d-90a7-4a5f-a308-99eb930e81a8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.707449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9de7d-90a7-4a5f-a308-99eb930e81a8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.707858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9de7d-90a7-4a5f-a308-99eb930e81a8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.714612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 81/154] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:13.716263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1c53-688a-4ba7-9ff2-9b4dd005bfa9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.716707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1c53-688a-4ba7-9ff2-9b4dd005bfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.717120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1c53-688a-4ba7-9ff2-9b4dd005bfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.754301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9a8c1c53-688a-4ba7-9ff2-9b4dd005bfa9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:13.755820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9a8c1c53-688a-4ba7-9ff2-9b4dd005bfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:13.756491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8328f-de5b-4de7-965f-8b013b58f198 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:13.834433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:13.870949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:13.872100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.872383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.872660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.873348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:13.873655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:13.875113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:13.880379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 82/155] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:13.881876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:13.882324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:13.882733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:13.893866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 74/156] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:13.903127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:13.911061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:13.912260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:13.938876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.042232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 83/157] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:14.083687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7960e-0500-4c8a-96a2-ff03f54cc32f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.128397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.129325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.129764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.130218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] PATH_INFO: `/v3/users/9cecdb078d514c1c90b41d86e7c9eae7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.131551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] RBAC: Authorizing `identity:get_user(user_id=9cecdb078d514c1c90b41d86e7c9eae7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.133182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def833d-145d-43ce-80b4-1e079c957a9c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.135072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 75/158] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:13 2022] GET /identity/v3/users/9cecdb078d514c1c90b41d86e7c9eae7 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:14.140832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.288540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe5ae-b62e-425e-b665-d77601079f32 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.328214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.328670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.328953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.329231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.330380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.331250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561f63-9e8d-4c22-877f-db43d0926b80 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.331827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.332268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561f63-9e8d-4c22-877f-db43d0926b80 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.332762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4561f63-9e8d-4c22-877f-db43d0926b80 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.333607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 84/159] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:14.339152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 76/160] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:14.341448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.346158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.346699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.347175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.367427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.382180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:14.383384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:14.449361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.475834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 77/161] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:14.513223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.514094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2655c5c-fec8-4856-b174-d1a54b79c79d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.555993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.556630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.556964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.557240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/9cecdb078d514c1c90b41d86e7c9eae7/roles/8b89535bd4944575b5d404e140836fd6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.561752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, user_id=9cecdb078d514c1c90b41d86e7c9eae7, role_id=8b89535bd4944575b5d404e140836fd6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:14.563254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:14.583374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 85/162] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:14 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/users/9cecdb078d514c1c90b41d86e7c9eae7/roles/8b89535bd4944575b5d404e140836fd6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:14.677700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9273a-d345-49f4-a91d-7535f4872a02 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.700414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.756450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.757092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.757366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.757633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:14.793052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:14.801261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:14.802222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:14.803007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 78/163] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:14.809007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:14.846466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.909939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9818-d0dd-4e58-b53d-c92d555611a2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:14.913605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:14.983292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:14.983963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:14.984240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:14.984510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.010828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:15.015891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:15.016796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:15.017622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:15.018247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fa3a-3747-4085-bd91-c787c0fc03d8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.018325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 86/164] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:15.023073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.064137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.064671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.064941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.066367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.067049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:15.067348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.068728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.089110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 79/165] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.095965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.220252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268633-e995-41a6-97e2-d4cc8e6c9798 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.274829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.287063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.287735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.288020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.288290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.288965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:15.289265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.291269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.307437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 87/166] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.308441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.332322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f147de-ed86-4869-8d82-7cd9a48732aa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.350414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.405580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.406259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.406536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.406804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.407953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.409420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.411051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 80/167] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.417981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.492504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe7a5e-85b6-4b1f-a46e-388c8cec44f5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.547127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.547889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.548108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.548438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.567721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:15.574060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:15.574935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:15.575795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 88/168] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:15.576451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.579908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82e39-736e-4d71-b36a-6924933a5c87 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.642810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.643564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.643841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.644100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.647631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.649408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf6d2-ae6b-4107-8305-1b9fdfbd9507 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.651637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 81/169] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.652774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f8c4-0160-432e-98c9-f7869b280491 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.653044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f8c4-0160-432e-98c9-f7869b280491 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.653307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f8c4-0160-432e-98c9-f7869b280491 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.654598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 82/170] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:15.655291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809f8c4-0160-432e-98c9-f7869b280491 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.678184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.750520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:15.762273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b63e5-05f6-4de6-bc3e-5f46da01ddeb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.820762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809f8c4-0160-432e-98c9-f7869b280491 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:15.823635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.824260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.824546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.824827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.901877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:15.902444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:15.902723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:15.902999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:15.903718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:15.904021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.905409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:15.926614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 83/171] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:15.927290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:15.958795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:15.960258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79e13-4793-4eb9-973f-ab7d135aa91b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.022301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.059236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532825e-61e5-465b-b6cf-bdc005d31138 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.074387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 89/172] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:16.074558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.077990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.078310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.078590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.099147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:16.100042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.100699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.100978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.101244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.101660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:16.175255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:16.176639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9bafd4-1e36-42ca-8b73-659bd0cff850 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.177264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 90/173] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:16.186837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.301455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.310636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 84/174] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:16.312630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdb92-851b-42b7-b104-9876d23697e5 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.312920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdb92-851b-42b7-b104-9876d23697e5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.313462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afdb92-851b-42b7-b104-9876d23697e5 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.315643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 85/175] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:16.316510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afdb92-851b-42b7-b104-9876d23697e5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.322157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062bad8-0970-42b1-9099-7c1a3d5bdb2a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.328011 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.358378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.359144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.359519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.359887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] PATH_INFO: `/v3/users/397a24e018744894addac09d82911043` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.361107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=397a24e018744894addac09d82911043)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:16.363125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0df6e7-a949-4a03-9da5-fb51986fbbf5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.365550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 91/176] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/users/397a24e018744894addac09d82911043 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:16.367194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83926a-e0db-4d82-9a06-7bfa4d200e7c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.367681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83926a-e0db-4d82-9a06-7bfa4d200e7c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.368171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83926a-e0db-4d82-9a06-7bfa4d200e7c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.370286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 92/177] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:16.371393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83926a-e0db-4d82-9a06-7bfa4d200e7c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.459062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afdb92-851b-42b7-b104-9876d23697e5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.483646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83926a-e0db-4d82-9a06-7bfa4d200e7c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.499824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.500447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.500718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.500980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.502156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:16.503606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce25d-5d67-49e3-a6c5-138535ed0f7c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.505450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 86/178] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:16.506340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267c79-0130-4382-8321-dda1e804c024 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.506615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267c79-0130-4382-8321-dda1e804c024 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.506880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7267c79-0130-4382-8321-dda1e804c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.525824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e7267c79-0130-4382-8321-dda1e804c024 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:16.527063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e7267c79-0130-4382-8321-dda1e804c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:16.528041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.528683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.528992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.529230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.530370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:16.531814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.538152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 93/179] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:16.538152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.562009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.604459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 87/180] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:16.605721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.606009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.606310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.623295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.638380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:16.639585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:16.654493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407df65-0031-43ff-b5af-943f62efa9d5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.693358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.694467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.694946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.695573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.728512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 88/181] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:16.729304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.800332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:16.807569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:16.845840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.907263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171b1f2-d699-490b-aa44-d5dbf9dfa3f6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:16.951531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 94/182] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:16.952433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:16.958009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:16.958692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:16.958970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:16.959243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:16.961274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:16.975629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:16.981795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:16.982814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:16.983722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 89/183] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:16.985053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.080856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb1ba7-01d2-4730-9daa-800cd654f384 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.101870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.103983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1dfa6-4c9c-438e-9f65-08e5667492d5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.117044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.117707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.117989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.118297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.119057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=397a24e018744894addac09d82911043) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:17.119366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.120791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.126775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 95/184] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.127601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.144212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.144842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.145122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.145395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.146295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=397a24e018744894addac09d82911043) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:17.146511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.148037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.156488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 90/185] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:16 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.157485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.236389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.275878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f361974-ae85-43e6-8271-03d219d178b4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.300185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2436c9-9d47-4a31-a41d-a90ef4173f5f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.322765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.323417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.323919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.324036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.337449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:17.343015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:17.343603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:17.344656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 96/186] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:17.345677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.346830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.347242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.347665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] PATH_INFO: `/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.349608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] RBAC: Authorizing `identity:get_project(project_id=a2799ee54f6b4d1abfe30c1e85171c24)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.351102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.353018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 91/187] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/projects/a2799ee54f6b4d1abfe30c1e85171c24 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.353678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.401605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.463938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc763-f0a3-46f9-a40a-472b8063c310 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.469247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdd01-5581-4e0c-bf9b-57a63ed1b102 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.495944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.497826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.498573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.498865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.499140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.499817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:17.500123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.501518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.504286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.504905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.505186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.505452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.506574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.508003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641c32-3f39-485f-969b-7d7121bfc162 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.514760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 92/188] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.514898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 97/189] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.514898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.515026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be7c1-c188-479f-a36c-6fe95484da74 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.515026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be7c1-c188-479f-a36c-6fe95484da74 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.515026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be7c1-c188-479f-a36c-6fe95484da74 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.515026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 93/190] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:17.518943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283be7c1-c188-479f-a36c-6fe95484da74 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.620018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5fc2-6dec-4f05-a4f5-be1c05656eec None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.624274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283be7c1-c188-479f-a36c-6fe95484da74 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.627047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.655836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.656449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.656731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.657010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.657672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:17.657976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.658494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.659103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.659383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.659473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.659653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.660372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=a2799ee54f6b4d1abfe30c1e85171c24, user.id=397a24e018744894addac09d82911043) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:17.660683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.662115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.667640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 98/191] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.678889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 94/192] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/role_assignments?user.id=397a24e018744894addac09d82911043&scope.project.id=a2799ee54f6b4d1abfe30c1e85171c24&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.679126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.679206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.740680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.793782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138d0b1-f2f2-41f2-a831-6620f59e0e3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.794422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681668c2-f59d-44d6-bd84-f31cefef56cb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:17.832780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.833403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.833685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.833959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.834717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.836197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.837689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:17.838628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.838628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.838883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.858140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:17.858325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049461ed-4d62-4ec3-8993-e49dad382d90 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:17.863069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 95/193] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:17.863069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:17.863069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:17.863069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:17.867987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 99/194] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:17 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:17.869387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:17.891504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:17.892732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:17.912051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:17.975319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 96/195] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:17.987198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.012512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853db8-1c1d-4307-b61b-87fdab9d4d3d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.069698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.071860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.072937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.073501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.074111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.077214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.080366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.083302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 100/196] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.090286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.150611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926e935-8752-488a-a1c2-963092c93c16 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.192733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.193348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.193676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.193952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.250875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.271794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8cddb-df1f-4b40-a730-5b236fd17e48 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.296669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.298299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.337259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.337814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.338131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.339514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.361952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.433423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.434163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 97/197] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:18.439518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.439645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.553562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.565513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 101/198] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:18.566429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.580724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec61758-2e41-49c4-b582-aeb39486a12b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.624506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.625091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.625369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.625667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.636434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:18.641676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:18.642595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:18.643386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 98/199] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:18.644012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.654156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.694570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9b3d3-b46c-491b-a456-8ccfd2a5073b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.737647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.738333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.738619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.738899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.740052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.741517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.748449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 102/200] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.748449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.772327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c555-4e4d-4cac-9f90-3f04e5e982ee None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.809753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.810411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.810695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.810963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.812165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.813749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.815927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.816452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 99/201] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.820211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.878480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3e6fa-0e13-40eb-87c1-4ef4d03be500 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.902240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:18.918139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.919118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.919590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.920129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.921035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:18.921526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.923334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.928958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a7616-5eca-4da6-a9fb-ea6c7cd47852 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:18.932298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 103/202] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.933267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:18.971156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:18.971654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:18.971992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:18.972264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:18.973040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=29e258f9fd7449cdaab4b3a2af2e2602) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:18.973352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:18.974827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:18.990132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 100/203] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/role_assignments?user.id=29e258f9fd7449cdaab4b3a2af2e2602&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:18.990132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:19.092674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4e297-13f9-4186-8bf5-05de5aba6fdb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:19.097995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff05fd-1f38-49a5-959e-e069a2d4da4d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:19.135190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:19.135812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:19.136093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:19.136414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] PATH_INFO: `/v3/users/9cecdb078d514c1c90b41d86e7c9eae7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:19.137616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] RBAC: Authorizing `identity:get_user(user_id=9cecdb078d514c1c90b41d86e7c9eae7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:19.139160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:19.141001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 101/204] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/users/9cecdb078d514c1c90b41d86e7c9eae7 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:19.146832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:19.147813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:19.171066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:19.178840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:19.179481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:19.179767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:19.180042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:19.180794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=29e258f9fd7449cdaab4b3a2af2e2602) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:19.181236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:19.182812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:19.194699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 104/205] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:18 2022] GET /identity/v3/role_assignments?user.id=29e258f9fd7449cdaab4b3a2af2e2602&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:19.273055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fee90a-32ec-4d53-a806-d6a03543bfeb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:19.311148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:19.311840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:19.312114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:19.312379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:19.388371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:19.389864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:19.453644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:19.495118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 102/206] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:19.503160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:19.624324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b39b-6288-46eb-ac93-dba432be7742 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:19.659243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:19.660208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:19.660688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:19.661175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:19.662534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:19.664168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f507c-879d-4697-b17f-f131284c89c1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:19.666081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 105/207] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:19 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:19.675330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:19.840447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7088f-1ff7-4a8a-844b-da8459c29484 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:19.853728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:19.883067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:19.883670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:19.883974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:19.884234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:19.884956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, scope.project.id=372be1e6a7714f3cb257be56e3c00274, user.id=9cecdb078d514c1c90b41d86e7c9eae7) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:19.885257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:19.886703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010177-ffdd-4b94-8f19-2fa0d556c89c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:19.892820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 103/208] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:19 2022] GET /identity/v3/role_assignments?user.id=9cecdb078d514c1c90b41d86e7c9eae7&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=8b89535bd4944575b5d404e140836fd6 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:20.360645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc01c3a-d946-4323-bc2e-286e6e07bc97 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.361152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc01c3a-d946-4323-bc2e-286e6e07bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.361225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc01c3a-d946-4323-bc2e-286e6e07bc97 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.362712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 106/209] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:20.368156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.369087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.369361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.389462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:20.390676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:20.411688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936c27-cd87-4f09-9322-06a420bd7074 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.411979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936c27-cd87-4f09-9322-06a420bd7074 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.412262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80936c27-cd87-4f09-9322-06a420bd7074 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.413611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 107/210] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:20.419859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.420316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.420757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.444361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:20.445853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:20.486114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 104/211] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:20.512587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.527397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 108/212] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:20.801338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:20.815044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:20.910661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:20.913687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91665223-9751-4a14-ae8d-2277e7e369d0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:20.936939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16dc59-eca8-4b8b-86a8-d46da99763ae None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:20.959066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b720-0072-477a-a228-661734b74f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:20.959703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b720-0072-477a-a228-661734b74f53 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.959980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b720-0072-477a-a228-661734b74f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.960250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b720-0072-477a-a228-661734b74f53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:20.961364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565b720-0072-477a-a228-661734b74f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:20.963524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565b720-0072-477a-a228-661734b74f53 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:20.970275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 105/213] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:20.971154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b720-0072-477a-a228-661734b74f53 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:20.980978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:20.981940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:20.982450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:20.983015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.003180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:21.008819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:21.010366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:21.011182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:21.017883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 109/214] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:21.024063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.101668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.174096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b720-0072-477a-a228-661734b74f53 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:21.195993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe76c0-a07d-4328-bb54-fe0ffa8448ac None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:21.241265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:21.242499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.242975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.244211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.247208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:21.247423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:21.248378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:21.248483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.248701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.249300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.249960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:21.251454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213fb70-3b35-4ccc-af75-4f8b17300c4a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:21.253344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd66eb-abc4-4321-ba9d-495db4f42dd4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:21.266413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 110/215] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:21.267664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a5ac-69ec-4667-b3eb-d4322e4ddc90 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.267949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a5ac-69ec-4667-b3eb-d4322e4ddc90 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.268223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a5ac-69ec-4667-b3eb-d4322e4ddc90 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.269586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 111/216] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:21.272932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a5ac-69ec-4667-b3eb-d4322e4ddc90 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.295915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 106/217] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:20 2022] POST /identity/v3/users => generated 297 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:29:21.295915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d7fc-38e8-49db-b56a-13ab1a51c4ec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.295915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d7fc-38e8-49db-b56a-13ab1a51c4ec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.295915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d7fc-38e8-49db-b56a-13ab1a51c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.329312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a541d7fc-38e8-49db-b56a-13ab1a51c4ec None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:21.330563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a541d7fc-38e8-49db-b56a-13ab1a51c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:21.361002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.417995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a5ac-69ec-4667-b3eb-d4322e4ddc90 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:21.426997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.433742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 107/218] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:21.435066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77869cd-6233-47be-bbd6-5839e6d57254 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.435348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77869cd-6233-47be-bbd6-5839e6d57254 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.435616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77869cd-6233-47be-bbd6-5839e6d57254 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.437063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 108/219] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:21.442305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.442578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.442848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.461950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:21.463434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:21.467766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:21.468407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.468687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.468961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] PATH_INFO: `/v3/users/81754646edc4440fb628358f0c35eeb0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.486983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] RBAC: Authorizing `identity:get_user(user_id=81754646edc4440fb628358f0c35eeb0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:21.488759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:21.491213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 112/220] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/users/81754646edc4440fb628358f0c35eeb0 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:21.497777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.550645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 109/221] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:21.613306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fd0d2-1d7b-497c-a41b-12fd1c092c3d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:21.647528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:21.648143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.648421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.648956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.685215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.707788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.726717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:21.728801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:21.824603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.842390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78d62f-8d4f-4e1c-bc00-d066b62f3a54 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:21.861116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:21.862210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.882367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:21.882932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:21.883208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:21.883644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:21.895063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:21.900797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:21.901655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:21.902471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:21.906519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 110/223] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:21.907443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:21.941147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:21.995478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a19a0-ec98-43c3-960c-bd9536ec65ba None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.028715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d3bc3-94c4-41cb-8c51-d9a0c769d200 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.034849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.035570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.035944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.036286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.047750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:22.052634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:22.054447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 114/224] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:22.056306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.070510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.071949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.072246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.072511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.074293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.075836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.077658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 111/225] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:21 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.082892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.098581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.185095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b522-fda6-4fc4-bdef-c7549e2fc2f3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.190516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a748923-0009-48fb-9571-c9e185bc4dff None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.215219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.231453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.232251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.232589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.232879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.233033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.233699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:22.233903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.234132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.234480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.234904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.235707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.235817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:22.236230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.237730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.244159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 115/226] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.248607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.251082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 112/227] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.252085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.330540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.359525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194caf6-a5f8-4b16-84e4-141c2d9fdf37 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.365854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255b43-fca2-40dd-b674-0ef8e369e191 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.396650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.397307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.397537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.397863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.398805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=81754646edc4440fb628358f0c35eeb0) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:22.399119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.400727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.402636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.403470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.403920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.404356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.405652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.406156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 116/228] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/role_assignments?user.id=81754646edc4440fb628358f0c35eeb0&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.406945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.407718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.409476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 113/229] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.415109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.510556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.523214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac6c7f-7ae3-4d67-af71-82e84edb3c18 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.578261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5234-4b25-4c5f-8516-2107ad08ba90 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.595488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.596490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.596988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.597478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.603423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.605240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.607530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 114/230] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.610708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.611493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.611842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.612209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.613468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.613811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.615131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.617058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 117/231] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:22.630128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.639855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.734020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277975eb-4365-483c-b306-e9c3b55e17dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.758472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:22.764699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d25bf9-7ede-48f8-a620-3f63b9d49fe0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.774180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.775195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.775482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.776486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.777068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.778623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.780573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 118/232] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:22 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:22.792734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:22.833842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.835151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.835435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.835707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/29e258f9fd7449cdaab4b3a2af2e2602/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.843573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, user_id=29e258f9fd7449cdaab4b3a2af2e2602, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:22.845195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb276c3-de73-4ed3-ac70-01006d440f48 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:22.869125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 115/233] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:22 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/29e258f9fd7449cdaab4b3a2af2e2602/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:29:22.943665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96197-28a0-4af0-9e83-5ae7566aa9b5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:22.992051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:22.993026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:22.993488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:22.994024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/29e258f9fd7449cdaab4b3a2af2e2602/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:22.997832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, user_id=29e258f9fd7449cdaab4b3a2af2e2602, role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:23.000106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613f008-6b06-43ed-a949-538a07cf1a0a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:23.025425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:22 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/29e258f9fd7449cdaab4b3a2af2e2602/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:29:23.729222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391849f5-792e-48f1-8702-687ddc272ea3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.729912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391849f5-792e-48f1-8702-687ddc272ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.730419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391849f5-792e-48f1-8702-687ddc272ea3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.732020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 116/235] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:23.737644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f78b-25ef-4240-8bd4-025c76abfcb2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.738544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f78b-25ef-4240-8bd4-025c76abfcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.739022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195f78b-25ef-4240-8bd4-025c76abfcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.766627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8195f78b-25ef-4240-8bd4-025c76abfcb2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:23.768180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8195f78b-25ef-4240-8bd4-025c76abfcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:23.832249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:23.883747 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:23.985578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e12ad-4587-426e-a39a-ad6792dc6da2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.986557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e12ad-4587-426e-a39a-ad6792dc6da2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.987051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e12ad-4587-426e-a39a-ad6792dc6da2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:23.988881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 117/237] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:23.995234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:23.995745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:23.996273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.024431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:24.026564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:24.105338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:24.217356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e12ad-4587-426e-a39a-ad6792dc6da2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.304540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:24.344875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e12ad-4587-426e-a39a-ad6792dc6da2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:24.395751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:24.396795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.397322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.397795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.399468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:24.401670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:24.403531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 118/239] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:24.409566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.462286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.545652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5162ef-5983-4b82-9a17-73f75f859565 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:24.553735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:24.606235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:24.606770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.607049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.607323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.607972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:24.609471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:24.629416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2db63-f684-4f42-b75f-7b7c72ca08e7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:24.670192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 122/240] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:24 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:24.670652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:24.671396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.671678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.671955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.685409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:24.686620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-69142dc8-2c8f-4134-b55f-8b160a8f8ebe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:24.692272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:24.693218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:24.694015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 119/241] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:24.703257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.815386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a893-a688-4d69-a4ff-9d847e7ef42c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.815725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a893-a688-4d69-a4ff-9d847e7ef42c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.815939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a893-a688-4d69-a4ff-9d847e7ef42c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.817307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 120/242] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:24.823294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.823568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.823846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.858299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:24.859438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:24.875850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bd4f3-2841-4781-8413-b838c549da1a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:24.918462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:24.919253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:24.919543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:24.920196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:24.920942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:24.921524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:24.923009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:24.933869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 123/243] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:24.939532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:24.942913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:24.971741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.063049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7223-9248-42de-ae31-154dbfa04386 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.099379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78725967-f190-455d-bd0f-273137889369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.100029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725967-f190-455d-bd0f-273137889369 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.100316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725967-f190-455d-bd0f-273137889369 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.100590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78725967-f190-455d-bd0f-273137889369 None admin] PATH_INFO: `/v3/users/39726d73820046458bf0ac9026030ab6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.114825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78725967-f190-455d-bd0f-273137889369 None admin] RBAC: Authorizing `identity:get_user(user_id=39726d73820046458bf0ac9026030ab6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:25.116317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78725967-f190-455d-bd0f-273137889369 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:25.118039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 124/245] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:24 2022] GET /identity/v3/users/39726d73820046458bf0ac9026030ab6 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:25.123940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:25.237021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673975e-d164-4d7f-8344-598afb83eb19 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.265697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.274544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78725967-f190-455d-bd0f-273137889369 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:25.279369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.282096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.282440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.282689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.385484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:25.387011 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e7308-02ca-4dec-9a05-00b0e149f3c9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:25.408513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.438552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78725967-f190-455d-bd0f-273137889369 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.481095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.481898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.483021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.483300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.499667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3673e0f2-011c-4064-83f2-60c37ceb7338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:25.505582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:25.506568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:25.507354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:25.507964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 125/246] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:25.509749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc41df-0d0a-4dcd-89e5-299afe4de1e9 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.510036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc41df-0d0a-4dcd-89e5-299afe4de1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.510503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc41df-0d0a-4dcd-89e5-299afe4de1e9 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.513551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 126/247] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:25.514334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc41df-0d0a-4dcd-89e5-299afe4de1e9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:25.524464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 122/248] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:25.525960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.526269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.526542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.545346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:25.546783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:25.574477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.631339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc41df-0d0a-4dcd-89e5-299afe4de1e9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.638526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 123/249] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:25.642954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:25.687466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.688985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.689262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.689530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.691242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:25.691544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:25.693171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d50b3-3de0-488c-b4dd-fd9c0f564a5e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:25.709863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 127/250] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:25.713097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f30e-476c-4b33-81db-65c462f9b83f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.713379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f30e-476c-4b33-81db-65c462f9b83f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.714603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f30e-476c-4b33-81db-65c462f9b83f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.719939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 128/251] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:25.720726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f30e-476c-4b33-81db-65c462f9b83f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:25.728176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.805713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbcb02-b9f8-4277-8f70-7adcffb91cdd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.871332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.871966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.872234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.872496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.876343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:25.877803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6212373-7294-477f-bdf8-d22a535da340 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:25.883657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 124/252] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:25.884678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.884953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.885300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.927157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:25.928668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:25.932520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f30e-476c-4b33-81db-65c462f9b83f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:25.966242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:25.966879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:25.967487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:25.967806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:25.968204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] PATH_INFO: `/v3/users/81754646edc4440fb628358f0c35eeb0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:25.969335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] RBAC: Authorizing `identity:get_user(user_id=81754646edc4440fb628358f0c35eeb0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:25.970803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:25.972541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 129/253] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/users/81754646edc4440fb628358f0c35eeb0 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:25.973144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.022051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 125/254] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:26.023254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.046456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.078044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65468ab-24ac-4ab6-9518-d84e24822487 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.113210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.113924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.114248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.114522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.115244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=39726d73820046458bf0ac9026030ab6) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:26.115550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.117169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.123380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 130/255] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:25 2022] GET /identity/v3/role_assignments?user.id=39726d73820046458bf0ac9026030ab6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=8b89535bd4944575b5d404e140836fd6 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:26.124252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.127137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273397e-6c41-4ab1-b6b2-501b345f2d37 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.166868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.167517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.167789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.168050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.180284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:26.185802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:26.186777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:26.187578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:26.191903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 126/256] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:26.193288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.233866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.267254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dbb50-ef9d-49ed-b84a-14d460b2a475 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.322156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.322809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.323089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.323365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.324523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.326973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.328676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 131/257] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:26.339002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.358515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.384446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bad3-8bf6-4e38-9f21-daf407da726e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.438301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.439260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.439826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.440299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.441180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:26.441677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.443299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.454619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 127/258] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:26.455727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.485323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56034b1-3fa9-4fb8-8439-77721c2652e5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.560478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.561560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.563534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.564027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/81754646edc4440fb628358f0c35eeb0/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.566440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.567332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, user_id=81754646edc4440fb628358f0c35eeb0, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.569731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.595222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 132/259] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:26 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/81754646edc4440fb628358f0c35eeb0/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:26.596072 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.603968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de86201-89e8-4cd1-88fa-53e98c83795d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.673350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.673991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.674290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.674557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.702321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.702695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:26.708003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:26.708916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:26.709823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 128/260] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:26.718339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.787582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce92b1-6541-43a7-9364-76cfb4b04821 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.842597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2aa95-c4f9-417b-a9a4-abcd7ffb5c96 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:26.877298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.877957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.878303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.878521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.883585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.885941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.888371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 133/261] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:26.890255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:26.891098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:26.891571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:26.892033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:26.892964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:26.893504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:26.894558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:26.896962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:26.911166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:26.917847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 129/262] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:26.923399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.032536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5283-86f4-495d-8639-9d5418ebe9c1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.068259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.069230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.069704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.070218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] PATH_INFO: `/v3/users/29e258f9fd7449cdaab4b3a2af2e2602` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.071582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] RBAC: Authorizing `identity:get_user(user_id=29e258f9fd7449cdaab4b3a2af2e2602)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.073245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.075539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 130/263] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/users/29e258f9fd7449cdaab4b3a2af2e2602 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:27.088049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.108530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6b21-9020-4577-bf7b-99241374ff77 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.169180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:27.180216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.180886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.181167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.181439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.222439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:27.275301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efbc70-7dc3-4827-b8c6-1243dccd43f4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.308397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.309811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.367438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.368061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.369066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.369516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.505226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 134/264] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 10:29:27.513253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.513435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.514759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.578581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:27.658477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:27.724233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:27.726293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.732211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2c28-d791-4f1d-aebf-db33cffd5f20 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.822798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.823458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.823739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.824016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.827828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.829340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.830859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee33c-80c8-421e-ac56-0620ef89cdfe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:27.831318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 135/266] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:27 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:27.847116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.891887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:27.893027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:27.893305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:27.893574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:27.894733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:27.896307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:27.898330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 132/267] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:27 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:27.907161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:27.980098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:28.042884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:28.047444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33038999-1ae3-49c4-9112-a740543c2009 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:28.072972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fd26-825b-426a-b0b7-f3fa8d29d3d8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:28.085906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:28.086604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.087006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.087865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.088668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=29e258f9fd7449cdaab4b3a2af2e2602) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:28.089049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:28.090597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009054f-8a68-4fe4-89d9-8d092bda5e71 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:28.099618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 136/268] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:27 2022] GET /identity/v3/role_assignments?user.id=29e258f9fd7449cdaab4b3a2af2e2602&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:28.100809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3244b-e8b5-4ef8-ada8-043d5104a5f8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.101153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3244b-e8b5-4ef8-ada8-043d5104a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.101488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3244b-e8b5-4ef8-ada8-043d5104a5f8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.103096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 137/269] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:28.108692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2cf85-d5ab-40ca-8efa-4b70ef7c3c22 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.109329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2cf85-d5ab-40ca-8efa-4b70ef7c3c22 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.109473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2cf85-d5ab-40ca-8efa-4b70ef7c3c22 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.111310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 138/270] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:28.112659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.113042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.113416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.132953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:28.134916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:28.138286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:28.140226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.140729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.141193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.142155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=29e258f9fd7449cdaab4b3a2af2e2602) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:28.142643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:28.144435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f75b4c-4510-4566-9f0f-6a2301db53a5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:28.159007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 133/271] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:27 2022] GET /identity/v3/role_assignments?user.id=29e258f9fd7449cdaab4b3a2af2e2602&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:28.160339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.166102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.166102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.205963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:28.207194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:28.284920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 139/272] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:28.366528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 134/273] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:28.632865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:28.684534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:28.729447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:28.745929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:28.754454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f73eb-4545-41ec-8a04-d26cc9ac9719 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:28.799814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:28.800456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.800735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.801004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.802136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:28.803620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd28bda-14cf-4ebc-b9ef-2f7b7ef4a08a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:28.805195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 140/274] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:28.806361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3a8d6-6b88-4870-80ff-a6ed6d7ae70c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.806643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3a8d6-6b88-4870-80ff-a6ed6d7ae70c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.806916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3a8d6-6b88-4870-80ff-a6ed6d7ae70c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.808256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 141/275] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:28.812549 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3a8d6-6b88-4870-80ff-a6ed6d7ae70c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:28.825379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c755fb-2f6d-43ad-82e9-e7327775dceb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:28.868340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:28.869281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.869556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.869819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.881203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d4d26355-7594-4938-8235-13f01ccc8f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:28.886568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:28.887448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:28.888290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 135/276] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:28.889463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.889569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.889800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.909013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:28.910250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:28.941148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3a8d6-6b88-4870-80ff-a6ed6d7ae70c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:28.982108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 136/277] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:28.983079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:28.991864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:28.992779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:28.993174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:28.993700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:28.994509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:28.996114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:29.019948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:29.026639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 142/278] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:28 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:29:29.135375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b81910-8737-4bd5-8619-9857b2bb3950 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:29.180051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:29.181201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.181488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.181761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.182469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:29.182773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:29.184162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:29.193947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 137/279] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:29.199289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.225605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:29.306160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.322766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b17307-58a3-4e3d-ac7c-b3abd3807ac0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:29.370790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:29.371439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.371721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.371992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] PATH_INFO: `/v3/users/8e7eedebe9b54900a31865983586550c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.388858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] RBAC: Authorizing `identity:get_user(user_id=8e7eedebe9b54900a31865983586550c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:29.390390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e4e9-49ae-4389-88f8-de009e2af576 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:29.392573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 143/280] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/users/8e7eedebe9b54900a31865983586550c => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:29.393779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0107-5ca0-4657-8585-9659937db84b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.394062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0107-5ca0-4657-8585-9659937db84b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.395273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0107-5ca0-4657-8585-9659937db84b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.400366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 144/281] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:29.405303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0107-5ca0-4657-8585-9659937db84b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.418003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:29.442484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26dfc3-03c7-4e05-8013-0c6303c4a3b4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:29.482582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:29.483217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.483490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.483753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.495095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2c348f90-d440-42df-8ce0-57e978f94409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:29.499932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:29.500824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:29.501649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 138/282] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:29.502809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.502972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.503238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.504606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:29.524256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:29.526512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:29.533119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0107-5ca0-4657-8585-9659937db84b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:29.571907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:29.572427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.572781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.573128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.573929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, user.id=8e7eedebe9b54900a31865983586550c, scope.system=all) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:29.574330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:29.575933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:29.581949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 145/283] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/role_assignments?user.id=8e7eedebe9b54900a31865983586550c&scope.system=all&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:29.587148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.610302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 139/284] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:29.776032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0ff8-bbd6-436b-a669-9f892f4aa6fb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:29.829536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:29.830415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:29.830814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:29.831166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:29.832101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:29.832414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:29.833834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:29.856075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 146/285] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:29.862793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.970835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:29.989708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:29.999777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:30.015290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29ba0a-5788-4e96-95dd-2f168abd757c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.060861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.061409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.061682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.061948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] PATH_INFO: `/v3/users/39726d73820046458bf0ac9026030ab6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.063101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=39726d73820046458bf0ac9026030ab6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:30.065422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:30.067075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 140/286] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/users/39726d73820046458bf0ac9026030ab6 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:30.073756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:30.172335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9929-46be-43e3-826f-e90749b37ea5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.216926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.217580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.217821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.218113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.230409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:30.238529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:30.239462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:30.240272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 147/287] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:30.251572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:30.324377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292c07-c1b7-4963-a9d0-569a57833eb0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.336328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:30.387176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.387806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.388144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.388405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.389281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4c147-d1f0-4f5d-80c8-aa6e3dc5cfa3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.389551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:30.391059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:30.393016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 141/288] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:30 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:30.405369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:30.428903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:30.433343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.433968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.434275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.434548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.435219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:30.435519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:30.436894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:30.447475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 148/289] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:30.459809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:30.594554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380236d-01e4-45c4-af5e-1ddb16206ea9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.645136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b2552-09e9-4e57-9568-fb9e9dffdd82 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.666977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.667803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.668085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.668361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/39726d73820046458bf0ac9026030ab6/roles/8b89535bd4944575b5d404e140836fd6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.671523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, user_id=39726d73820046458bf0ac9026030ab6, role_id=8b89535bd4944575b5d404e140836fd6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:30.672939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:30.696248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:30.698658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 142/290] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:29:30 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/users/39726d73820046458bf0ac9026030ab6/roles/8b89535bd4944575b5d404e140836fd6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:30.710637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.711292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.711573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.711849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] PATH_INFO: `/v3/users/81754646edc4440fb628358f0c35eeb0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:30.713625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] RBAC: Authorizing `identity:get_user(user_id=81754646edc4440fb628358f0c35eeb0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:30.715126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:30.717081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 149/291] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:30 2022] GET /identity/v3/users/81754646edc4440fb628358f0c35eeb0 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:30.723258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:30.832241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:30.880977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d752043-bd74-4c28-845b-0f16ad527b1f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:30.931614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:30.932466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:30.932912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:30.933326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.019717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:31.021407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:31.105406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:31.142788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 143/292] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:31.151609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:31.308856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253f5e-b563-4b73-8c85-b9884bef08fa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:31.355496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:31.356148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.356433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.356713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.357864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:31.359342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e2a66-ed7c-42a5-9767-82f76a9df190 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:31.361293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 150/293] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:31 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:31.367210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:31.516658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570bb80-c16f-44bc-b4f4-4d5a84ada0ce None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.516843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570bb80-c16f-44bc-b4f4-4d5a84ada0ce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.517103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570bb80-c16f-44bc-b4f4-4d5a84ada0ce None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.518728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 151/294] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:31.524301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babd32-9087-4921-a5c8-74f23181edcf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.524623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babd32-9087-4921-a5c8-74f23181edcf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.524900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babd32-9087-4921-a5c8-74f23181edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.546989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7c4b7-ac10-4933-9797-8620d62d8c51 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:31.559087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-79babd32-9087-4921-a5c8-74f23181edcf None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:31.560305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-79babd32-9087-4921-a5c8-74f23181edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:31.605566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:31.606659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.607212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.607736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.609317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=81754646edc4440fb628358f0c35eeb0) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:31.609878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:31.612229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfb83d-30d0-47d4-8e27-c63e5030ba4e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:31.621786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 144/295] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:31 2022] GET /identity/v3/role_assignments?user.id=81754646edc4440fb628358f0c35eeb0&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:31.623706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f48b-edad-4483-9150-2cb5f3b33ff6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.624219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f48b-edad-4483-9150-2cb5f3b33ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.624693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f48b-edad-4483-9150-2cb5f3b33ff6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.626775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 145/296] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:31.637693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.639719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.640551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:31.640970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.680091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 152/297] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:31.691447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:31.693214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:31.750443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:31.812059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 146/298] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:31.964906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a1b4-863c-4a02-8965-7b2e2f31a22c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.965223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a1b4-863c-4a02-8965-7b2e2f31a22c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.965499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a1b4-863c-4a02-8965-7b2e2f31a22c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:31.967423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 153/299] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:31.970593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:31.972491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:31.972801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:31.973111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.004702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:32.006888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:32.113396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3fd82-332b-4766-b9dc-cb96b593c6b9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.138888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 154/300] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:32.139786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.159538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca175-632c-4237-b965-413893950d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.160556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca175-632c-4237-b965-413893950d82 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.161031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca175-632c-4237-b965-413893950d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.161488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fca175-632c-4237-b965-413893950d82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.173587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fca175-632c-4237-b965-413893950d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e5fca175-632c-4237-b965-413893950d82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:32.179075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:32.179952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:32.180827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:32.188749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 147/301] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:32.189867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca175-632c-4237-b965-413893950d82 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.219115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.244145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbca38-848b-4026-8c30-8c517b10d73c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.266327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.283827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.284408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.284843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.285133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.286464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.288282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.290103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 155/302] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:32.296357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.324147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fca175-632c-4237-b965-413893950d82 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.380122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.380657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.380936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.381203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.382027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:32.382364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.384117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.398962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 148/303] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:32.401128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.428365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b761e1-085d-4b43-a450-8b72886024d1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.477775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.478680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.479016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.479299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] PATH_INFO: `/v3/groups` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.480365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.482383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.503626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.514350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 156/304] 10.222.0.52 () {60 vars in 1134 bytes} [Wed Aug 24 10:29:32 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:32.514350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.535440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ff652-6730-4923-9377-bfbc474ad4e6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.576779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.577565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.577937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.578329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] PATH_INFO: `/v3/users/14c190e5868343dca83785964bd3dee3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.587123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.604459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] RBAC: Authorizing `identity:get_user(user_id=14c190e5868343dca83785964bd3dee3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.607046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.609761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 149/305] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/users/14c190e5868343dca83785964bd3dee3 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:32.617016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.672296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593a43-37ac-46b8-bd3c-a0e0e3adaad7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.720848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.721576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.721859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.723091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.741989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:32.747485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:32.748418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:32.750639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 157/306] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:32.760921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.774004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e029f4-3fc1-403f-8640-4f94ee2ba6af None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.821874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.822670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.823054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.823719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.824290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, user.id=14c190e5868343dca83785964bd3dee3, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:32.824782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.826530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.840282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 150/307] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/role_assignments?user.id=14c190e5868343dca83785964bd3dee3&scope.system=all&role.id=8b89535bd4944575b5d404e140836fd6 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:32.879240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fdbd4-f6a5-4229-8d54-f078163a3d60 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:32.890525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:32.920299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:32.921277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:32.921739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:32.922224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:32.923159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:32.923644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:32.925300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0ebe2-b9bd-4a6d-b036-5cc8ee955fdd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:32.936272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 158/308] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:32.946132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:32.953449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:33.056328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9742f-63ac-4b41-b9dc-1e1049f6ffc8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:33.094722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:33.095358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.095636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.095907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] PATH_INFO: `/v3/users/8e7eedebe9b54900a31865983586550c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.097064 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] RBAC: Authorizing `identity:get_user(user_id=8e7eedebe9b54900a31865983586550c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:33.098552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:33.100159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 151/309] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:32 2022] GET /identity/v3/users/8e7eedebe9b54900a31865983586550c => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:33.101293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73d6a-2dc1-4acd-a146-1ebd94210ffe None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.101584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73d6a-2dc1-4acd-a146-1ebd94210ffe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.101865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73d6a-2dc1-4acd-a146-1ebd94210ffe None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.103910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 159/310] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:33.106156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:33.109826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.110138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.110418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.130114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:33.131771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:33.194686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:33.230100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 160/311] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:33.230748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874977ca-66ba-4014-9c71-6f3cce9b939a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:33.266707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:33.267351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.267629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.267901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] PATH_INFO: `/v3/system/users/8e7eedebe9b54900a31865983586550c/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.269317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8e7eedebe9b54900a31865983586550c, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:33.270783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:33.283480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 152/312] 10.222.0.52 () {58 vars in 1334 bytes} [Wed Aug 24 10:29:33 2022] PUT /identity/v3/system/users/8e7eedebe9b54900a31865983586550c/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:33.506503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:33.609596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:33.613389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af1c92-599c-4c19-ae0f-29ba2819c12f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:33.650600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:33.651241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.651522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.651797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.663547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:33.668858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:33.669717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:33.670552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 161/313] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:33.677850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:33.826229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1075d-8e70-421b-b572-02b0ad01a0a7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:33.862560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:33.863167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:33.863447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:33.863716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:33.864379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:33.864682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:33.866057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:33.871344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:33.875097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 153/314] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:33.883134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:34.001853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767fbaa-2e29-4530-88cd-8dc9332d0878 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:34.042209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:34.042999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.043397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.043691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] PATH_INFO: `/v3/users/39726d73820046458bf0ac9026030ab6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.044983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] RBAC: Authorizing `identity:get_user(user_id=39726d73820046458bf0ac9026030ab6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:34.046705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:34.048668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 162/315] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:33 2022] GET /identity/v3/users/39726d73820046458bf0ac9026030ab6 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:34.055845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:34.181142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9655-7c8b-4ecf-a844-438f10597487 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:34.221795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:34.222542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.222857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.223186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.297812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:34.301247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:34.303107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013321b0-96b4-4037-8f4a-c861d175634e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:34.421732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 154/316] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:34.427476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:34.465409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:34.549129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e979-ff9d-4449-b2ab-88a51b3d9eff None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:34.578288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea3c1-f1e5-4ce5-9e0e-269b1d0a0adf None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.578907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea3c1-f1e5-4ce5-9e0e-269b1d0a0adf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.579863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ea3c1-f1e5-4ce5-9e0e-269b1d0a0adf None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.582184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 155/317] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:34.588101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d237d0-430f-407b-af32-0d68d0c45446 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.588749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d237d0-430f-407b-af32-0d68d0c45446 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.589361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d237d0-430f-407b-af32-0d68d0c45446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.591081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:34.591720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.592002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.592281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.593418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:34.594870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:34.600839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 163/318] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:34 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:34.602990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:34.610806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b0d237d0-430f-407b-af32-0d68d0c45446 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:34.612005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b0d237d0-430f-407b-af32-0d68d0c45446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:34.707365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 156/319] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:34.717189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:34.725568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ccb0-9ea7-4f94-8a1d-395109405184 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:34.762635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:34.763634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.764137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.764612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.765593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34, user.id=39726d73820046458bf0ac9026030ab6) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:34.766182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:34.767903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838446e9-db81-4cac-b8a0-c81e3f9da39b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:34.775027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 164/320] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:29:34 2022] GET /identity/v3/role_assignments?user.id=39726d73820046458bf0ac9026030ab6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=8b89535bd4944575b5d404e140836fd6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:34.775759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e67-de92-41df-b08d-fe5754ca350d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.776107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e67-de92-41df-b08d-fe5754ca350d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.776382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d87e67-de92-41df-b08d-fe5754ca350d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.777866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 157/321] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:34.783877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:34.784542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:34.785024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:34.807189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:34.808822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:34.890151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 165/322] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:34.996453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87e67-de92-41df-b08d-fe5754ca350d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.030221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:35.109866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d87e67-de92-41df-b08d-fe5754ca350d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.145058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.145684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.146014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.146314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.147408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:35.149310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:35.154160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 158/323] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:35.157371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.175731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.258720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:35.272912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef619-a744-43d5-bc56-3df254fb2ad5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.291132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:35.295456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7bcdc-cc98-4c1d-87fa-bf96a644a91c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.313811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.314587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.314862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.315131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] PATH_INFO: `/v3/groups` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.315874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:35.317431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8b488-a8e8-4cfd-9f62-019b58d06160 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:35.343095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 166/324] 10.222.0.52 () {60 vars in 1134 bytes} [Wed Aug 24 10:29:35 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:35.343285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.343285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.343285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.343285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.345604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905837-bb17-4b19-a3f6-1fee0e91cf06 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.345942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905837-bb17-4b19-a3f6-1fee0e91cf06 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.346312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b905837-bb17-4b19-a3f6-1fee0e91cf06 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.348055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 167/325] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:35.355990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:35.356210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.356210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.356210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:35.360419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:35.361396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:35.362751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 159/326] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:35.371618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.380518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:35.382505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:35.466549 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 168/327] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:35.500133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a92a-aa5e-456d-9c26-68d251530ea5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.537999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.538693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.538986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.539285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.539993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:35.540849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:35.542255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:35.551648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 160/328] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:35.557097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.646672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:35.667943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f16209-ccf2-492f-810f-e267dd40019b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.709733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.710411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.710690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.710962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] PATH_INFO: `/v3/users/14c190e5868343dca83785964bd3dee3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.712628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] RBAC: Authorizing `identity:get_user(user_id=14c190e5868343dca83785964bd3dee3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:35.714114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:35.715890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 169/329] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:35 2022] GET /identity/v3/users/14c190e5868343dca83785964bd3dee3 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:35.721417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.737771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:35.747530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:35.861672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8270b27-fede-47b7-af1b-87a451924d1a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.879886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d248-68e0-4404-8f0e-82f226a957a9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:35.907839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.908677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.908955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.909497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] PATH_INFO: `/v3/system/users/14c190e5868343dca83785964bd3dee3/roles/8b89535bd4944575b5d404e140836fd6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.911079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=14c190e5868343dca83785964bd3dee3, role_id=8b89535bd4944575b5d404e140836fd6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:35.912466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:35.926122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 161/330] 10.222.0.52 () {58 vars in 1334 bytes} [Wed Aug 24 10:29:35 2022] PUT /identity/v3/system/users/14c190e5868343dca83785964bd3dee3/roles/8b89535bd4944575b5d404e140836fd6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:35.937477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:35.938210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:35.938489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:35.938761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:35.952879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:35.958061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:35.959023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:35.959807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 170/331] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:35.966988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:36.099592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:36.122325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f431-063f-4231-82fd-56298c870276 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:36.164725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:36.166107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:36.166580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:36.167078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:36.167795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:36.168104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:36.169913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:36.181069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 162/332] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:36.187179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:36.203768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:36.324148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730cd5-dc35-4b5c-9c6d-de39946430e8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:36.369701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:36.370311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:36.370590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:36.370863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] PATH_INFO: `/v3/users/8e7eedebe9b54900a31865983586550c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:36.372021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] RBAC: Authorizing `identity:get_user(user_id=8e7eedebe9b54900a31865983586550c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:36.373469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516d31b-a611-4f0e-81eb-8c77e7c2d79a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:36.375462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 171/333] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:36 2022] GET /identity/v3/users/8e7eedebe9b54900a31865983586550c => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:36.381052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:36.527079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa896-0335-4894-b0c4-a561d83e4231 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:36.580150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:36.580814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:36.581099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:36.581364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:36.582111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] RBAC: Adding query filter params (role.id=266f2149c31e44dbae08f90e49f8ce15, user.id=8e7eedebe9b54900a31865983586550c, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:36.582427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:36.583871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8cc51-dfd5-4171-8eea-ed60c75e6c33 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:36.605093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 163/334] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 24 10:29:36 2022] GET /identity/v3/role_assignments?user.id=8e7eedebe9b54900a31865983586550c&scope.system=all&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:37.639180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27ad3a-3480-4281-8450-dc13c7459982 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:37.640373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27ad3a-3480-4281-8450-dc13c7459982 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:37.640887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27ad3a-3480-4281-8450-dc13c7459982 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:37.642954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 172/335] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:37.650447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03274-0b57-44b6-a449-d2422259e55a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:37.651409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03274-0b57-44b6-a449-d2422259e55a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:37.651916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03274-0b57-44b6-a449-d2422259e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:37.661597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:37.677123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3ff03274-0b57-44b6-a449-d2422259e55a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:37.679046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3ff03274-0b57-44b6-a449-d2422259e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:37.770180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 164/336] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:38.323805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27ad3a-3480-4281-8450-dc13c7459982 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:38.386813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884fa5f-e066-4146-8aff-54570bff06e1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.387460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884fa5f-e066-4146-8aff-54570bff06e1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.387988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884fa5f-e066-4146-8aff-54570bff06e1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.390039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 165/337] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:38.395282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.395868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.396406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.426586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:38.428448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:38.434109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:38.471438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27ad3a-3480-4281-8450-dc13c7459982 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:38.513546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:38.514225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.514503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.514779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.534697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:38.539457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:38.541048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:38.542038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:38.542813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 173/338] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:38.547186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:38.608031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 166/339] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:38.688831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc48e2-e66c-4587-afb0-8480628648a1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:38.733759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08436511-096b-49c7-a182-7c8178237313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:38.734410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436511-096b-49c7-a182-7c8178237313 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.734690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436511-096b-49c7-a182-7c8178237313 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.734961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436511-096b-49c7-a182-7c8178237313 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.735639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08436511-096b-49c7-a182-7c8178237313 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:38.735942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08436511-096b-49c7-a182-7c8178237313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:38.737317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08436511-096b-49c7-a182-7c8178237313 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:38.739832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:38.748531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 174/340] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:38.754859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:38.771988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5631a-16a2-4823-baa9-3abddd9f4e40 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.772273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5631a-16a2-4823-baa9-3abddd9f4e40 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.772547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5631a-16a2-4823-baa9-3abddd9f4e40 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.775086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 175/341] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:38.780229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe8f9-ae4a-4a12-9aeb-8fcacf3018c1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.780743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe8f9-ae4a-4a12-9aeb-8fcacf3018c1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:38.781151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe8f9-ae4a-4a12-9aeb-8fcacf3018c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:38.799294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6debe8f9-ae4a-4a12-9aeb-8fcacf3018c1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:38.800777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6debe8f9-ae4a-4a12-9aeb-8fcacf3018c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:38.878253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 176/342] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:38.887091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:38.939458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ac57c-e4cb-4637-896b-1f09a649196d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:38.998811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:38.999487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:38.999768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.000067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.098010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:39.099502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:39.132812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112133-126a-47eb-8593-4ef42ceb2ac5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.133423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112133-126a-47eb-8593-4ef42ceb2ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.134519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31112133-126a-47eb-8593-4ef42ceb2ac5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.139843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 177/343] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:39.145784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.146318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.146801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.178553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:39.180115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:39.185719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.260485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 167/344] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:39.260485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.279613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 178/345] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:39.280909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.347362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.371188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f8d4-2b2b-4ab4-b2c6-d23e4e27161e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.398215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eff56-8661-4b63-86bd-54923984d2d4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.431141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.432057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.432478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.432888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.460088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.460873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.461308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.461674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.469628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:39.474028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:39.475752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:39.478093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:39.478920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:39.480719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:39.490329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 179/346] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:39.491457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.493806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 168/347] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:39.494901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.555114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.601833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f7c78-f23d-44e8-aefc-18ef19a557cc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.622459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.641061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.641818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.642214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.642880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.644140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:39.645731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:39.648117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 180/348] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:39.651087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.713159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62eebd-189a-4d18-a06a-4b28025d67d9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.751888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.753037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.753808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.754318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.755401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:39.756381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:39.758536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:39.764493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057d30-0f47-4dc1-865b-93787723d89c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.770000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 169/349] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:39.771125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.812238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.812852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.813132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.813796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.814082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:39.814428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:39.815784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bc153-fad8-4d80-aeb6-331ae961189e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:39.824196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 181/350] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:39.825542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12c93-53cd-425e-9849-25f7284578a4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12c93-53cd-425e-9849-25f7284578a4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.826118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b12c93-53cd-425e-9849-25f7284578a4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.827721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 182/351] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:39.828429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b12c93-53cd-425e-9849-25f7284578a4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:39.893951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.895419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:39.921444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cdbf1-475f-4684-b7c9-fa668fa45f06 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.974961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:39.975608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:39.975908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:39.976256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:39.981069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b12c93-53cd-425e-9849-25f7284578a4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:39.985013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:39.987017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:39.988790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 170/352] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:39.989481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.029818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.031117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.031404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.032002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.048886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:40.056484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:40.057381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:40.058818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 183/353] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:40.059490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.121961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c68085-ab5c-475b-8565-290cb2775ccb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.177202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.178029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.178394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.178722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] PATH_INFO: `/v3/users/14c190e5868343dca83785964bd3dee3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.181705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] RBAC: Authorizing `identity:get_user(user_id=14c190e5868343dca83785964bd3dee3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.183459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98158d8-96f7-4023-963b-d1dcaa624d0b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.185525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 171/354] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:29:39 2022] GET /identity/v3/users/14c190e5868343dca83785964bd3dee3 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:40.186760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.188298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.189379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.214578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395a93f-36e6-459a-84d2-b276a83bdea0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.216171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:40.219068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:40.230734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.239825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.272403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.273172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.273708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.273985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.312232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 172/355] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:40.312467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.363541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.365605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.447534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4742b0-8c53-4114-8e35-f9f899560e05 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.498618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.499291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.499566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.499832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.500563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=372be1e6a7714f3cb257be56e3c00274) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:40.500706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 184/356] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:40.500914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.501523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.502550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.510220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 173/357] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:40.511554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.513717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.541613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.674234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149a4a6-3d4b-409e-9804-2472297d7f89 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.680981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a6af4-1e5d-4f6b-8a15-ec133d48135f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.721358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.721358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.721358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.721672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.722350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] RBAC: Adding query filter params (role.id=8b89535bd4944575b5d404e140836fd6, user.id=14c190e5868343dca83785964bd3dee3, scope.system=all) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:40.722654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.724098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c25f2-2a8d-4dc6-8ff8-0003d6f2e3b3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.727946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.728789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.729321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.729793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.730674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:40.731173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.732730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.737811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 174/358] 10.222.0.52 () {56 vars in 1308 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/role_assignments?user.id=14c190e5868343dca83785964bd3dee3&scope.system=all&role.id=8b89535bd4944575b5d404e140836fd6 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:40.742104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42866-573b-425a-8920-3dedbddb0ce7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.742104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42866-573b-425a-8920-3dedbddb0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.742104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42866-573b-425a-8920-3dedbddb0ce7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.742104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 175/359] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:40.742104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42866-573b-425a-8920-3dedbddb0ce7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.742485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 185/360] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:40.743891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.845336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.882513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:40.893944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51138-f1a9-4141-b0c9-c12a08c74b00 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.899800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42866-573b-425a-8920-3dedbddb0ce7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:40.943838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.944175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.944412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.944687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.951786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:40.951786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.951786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.951786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.952965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:40.954514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b48ff-d453-4819-b1b5-fb107f084094 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:40.958235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 176/361] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:40.959541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:40.959847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:40.960102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:40.970158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:40.978217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:40.979159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:40.979951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 186/362] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:40.980605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:40.982290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:40.983578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:41.087444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 177/363] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:41.088571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.117750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceddd2-5dfd-433f-9b51-f064b14f5209 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.154802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.163527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.164541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.165577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.166149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.190650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.232292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da414c0-a0f2-4bc7-89b6-2771885ee310 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.256388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.258144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.275373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.276008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.276277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.276541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.278936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.280502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.282114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 178/364] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:41.282868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.403250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 187/365] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:41.405687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.424813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b00cd-4fc8-4fec-b96b-5154360fb1da None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.441333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.480053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.480738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.481076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.481389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.482165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:41.482548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.484105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.486867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.494336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 179/366] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:41.495272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.532859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eed11-e5d1-4fdd-afc1-7052a86e8240 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.588956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.590037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.590473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.590818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.591561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=372be1e6a7714f3cb257be56e3c00274) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:41.591870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.593321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.599459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 188/367] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:41.603154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.634281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88cb6-2f87-4b31-9746-ff246f45f997 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.686108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.686108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.686108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.686108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.686517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.686517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.688596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 180/368] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:41.689462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.730501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.739491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9966a-bd5f-4dc8-8d77-cf3b01383b86 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.781290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:41.783405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.784096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.784382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.784707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.801157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:41.807080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:41.808204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:41.809164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 189/369] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:41.809954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:41.837594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa57e0-d56f-48f9-9b5c-569ab6db5060 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.888886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.889607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:41.889827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:41.890114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:41.956473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c511c9-b0fd-498d-bf6c-ef341357264c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:41.967527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:41.969161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:41.998529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:41.999626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.000198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.000712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.002316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.004800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.007201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 190/370] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.008303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.043419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.044229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.085549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 181/371] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:42.086252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.143289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8425d4-5314-4ba4-83e5-40a07335ce8d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.186112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.187964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.188986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.190123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.191680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:42.192368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.194500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.206269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 191/372] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.207618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.213506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73849e-482e-4939-b75e-99312f57c3e6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.266113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.267425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.268119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.268551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.269469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:42.270031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.271744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.280192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 182/373] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.281282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.357381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.363573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.381026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ee3f-dc89-48f3-81a9-e30afbeef777 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.422187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.422857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.423141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.423419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.424738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.426312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.428368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 192/374] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.435342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.480472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc07fb5-d545-4bd9-8d23-48e239ef4383 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.522685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.523227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.523772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.524183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.582137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a139d-00dc-460d-a1ac-236c51511347 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.615508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.617020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.623620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.624324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.624608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.624932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.626088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.627550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.629451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 193/375] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.635861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.652454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.672015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:42.778507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef1de-ffd8-42c1-a92e-6d3cc561f7ad None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:42.810422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 183/376] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:42.816884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:42.840508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:42.842371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.842371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.842677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.844904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:42.845227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:42.847112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc1fe-d88d-4f44-b5ac-b1f0fe0a9e75 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:42.862982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 194/377] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:42.938606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165698e-47b6-4144-b693-970580dfb840 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.938934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165698e-47b6-4144-b693-970580dfb840 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.939163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165698e-47b6-4144-b693-970580dfb840 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.940636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 195/378] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:42.948196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:42.948458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:42.948734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:42.976499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:42.977764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:43.012195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bc1f3-8611-4604-8e4e-ce5315e093e1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:43.079737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:43.089092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:43.089722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:43.089998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:43.090352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] PATH_INFO: `/v3/projects/4732e69892d041d9ae3567e9b16b15ff` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:43.094566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] RBAC: Authorizing `identity:get_project(project_id=4732e69892d041d9ae3567e9b16b15ff)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:43.094566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:43.096588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 184/379] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:42 2022] GET /identity/v3/projects/4732e69892d041d9ae3567e9b16b15ff => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:43.100670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 196/380] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:43.101877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:43.219153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24570b-c6cb-482e-a097-aa6780cf66ce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:43.260815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:43.261773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:43.262264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:43.262721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] PATH_INFO: `/v3/groups/f36869b972054d27aa548a0f292c1dea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:43.268248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] RBAC: Authorizing `identity:get_group(group_id=f36869b972054d27aa548a0f292c1dea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:43.269896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:43.271736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 185/381] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:43 2022] GET /identity/v3/groups/f36869b972054d27aa548a0f292c1dea => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:43.278404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:43.297850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:43.401080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45dd0c-391c-4621-b738-6a8670613d9f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:43.450761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:43.451384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:43.451665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:43.451930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:43.452661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] RBAC: Adding query filter params (group.id=f36869b972054d27aa548a0f292c1dea, role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=4732e69892d041d9ae3567e9b16b15ff) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:43.452967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:43.454435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:43.463620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 197/382] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:43 2022] GET /identity/v3/role_assignments?group.id=f36869b972054d27aa548a0f292c1dea&scope.project.id=4732e69892d041d9ae3567e9b16b15ff&role.id=88421fc218124abeb809266ecb9668ea => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:43.592937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:43.675158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:43.730941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d60b8-160d-4c8a-b547-794d9bbe57da None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:43.772235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:43.772890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:43.773169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:43.773696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:43.787632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:43.793180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:43.794154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:43.795000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 186/383] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:43.801904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:43.948019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:43.990641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3718cf-1ab7-4d0c-b1e3-e5b5697773f7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:44.056987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:44.057881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.058318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.058727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.059728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:44.060188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:44.062527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127ff81-7c5e-413c-852c-23b72fa86469 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:44.079710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 198/384] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:44.087212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:44.263793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c22f5b-113c-49f1-b246-cc738ed0cb6f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:44.289637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf96ff-3d89-44b3-bdcf-2ac6a9bdd3ec None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.290699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf96ff-3d89-44b3-bdcf-2ac6a9bdd3ec None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.291113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf96ff-3d89-44b3-bdcf-2ac6a9bdd3ec None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.293187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 199/385] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:44.298827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.299105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.299552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.316381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:44.337651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:44.341555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:44.349864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:44.350801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.351187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.351572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.355031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:44.358758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:44.360844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 187/386] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:44 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:44.366686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:44.471748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 200/387] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:44.561193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ad7ba-772b-494e-89e4-41763df57907 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:44.618358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:44.619250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.619675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.620086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.622044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:44.624572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:44.627375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 188/388] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:44 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:44.634332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:44.747198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:44.797109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4679-3dca-40d0-9856-ad131714a365 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:44.839293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:44.840238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:44.840755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:44.841235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:44.843404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, group_id=6ceb92d6c1404cbba5c77123146e2ba6, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:44.845076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:44.868139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 201/389] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 24 10:29:44 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:44.913068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.012764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:45.067742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763da3a-723f-4752-a653-ecde6f0a718c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.110176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.110770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.111017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.111291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.123759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ffc53623-095f-437e-97e7-eb9a755aba3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:45.128624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:45.129511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:45.130396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 189/390] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:45.136508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.161754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8823-7b0e-409c-a995-f869e752a5a2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.162128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8823-7b0e-409c-a995-f869e752a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.162320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde8823-7b0e-409c-a995-f869e752a5a2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.163931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 190/391] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:45.169336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.169813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.170264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.194476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:45.196020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:45.262015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090745-5b6e-436a-a2b1-32c4b077fab1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.282435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 191/392] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:45.304566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:45.310738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.311240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.311532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.311837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.312598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:45.312912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:45.314383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:45.323166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 202/393] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:45.328856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.406302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:45.474062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08d8c8-2de1-4ba3-878e-78b811c3982d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.521196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.521841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.522139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.522412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.523815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:45.525299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013928d7-99df-4a0c-ab17-4d68894e93c2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:45.526928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 192/394] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:45 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:45.532584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.559921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401681f-c7bf-4921-95a0-48c7b4618074 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.560242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401681f-c7bf-4921-95a0-48c7b4618074 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.560466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401681f-c7bf-4921-95a0-48c7b4618074 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.562004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 193/395] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:45.567523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.567808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.568081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.596499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:45.598676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:45.667571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96028-a9f2-45ab-831f-1976527f9d6e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.685488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 194/396] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:45.686468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.702717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.703361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.703643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.703922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.705086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:45.713769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:45.713769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 203/397] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:45 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:45.715006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:45.774933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:45.857502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:45.893089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1042a5-5183-43c6-9966-8992107517b1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.952505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7798b-f90c-4728-b0ad-7e45f56831f5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:45.975320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.976355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.976885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.977598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.989310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:45.991497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:45.992251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:45.992595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:45.992992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:45.995219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] RBAC: Authorizing `identity:create_grant(project_id=372be1e6a7714f3cb257be56e3c00274, group_id=6ceb92d6c1404cbba5c77123146e2ba6, role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:45.995634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:45.996489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:45.997277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:45.997871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:45.999674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 195/398] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:46.000642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.014130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 204/399] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 24 10:29:45 2022] PUT /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:29:46.015502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.116604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632c138-1ba9-4141-b2d0-ea9b61a524ac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.130482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.131198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae62ce7-ff4d-42be-a617-b36647a28390 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.155070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.165965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.167508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.168355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.169078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.174115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.174743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.175088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.175425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.176177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:46.176557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.178013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.187509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 205/400] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.190458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:46.196866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:46.201486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:46.202458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:46.203314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:46.206047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 196/401] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:46.212507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.377281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e1d8f-b498-4ee7-a741-98803630d7e2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.382601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8bd90-7b03-4f55-b914-6ce631044e03 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.441094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.442032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.442638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.443111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.444039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.444235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:46.444713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.445814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.447077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.447744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.447919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.450261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.453710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09fc2-9b06-408c-9c8b-4c1619c2259d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.457612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 206/402] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.460157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c3b2-4e24-4f33-952d-210253259d91 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.460998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c3b2-4e24-4f33-952d-210253259d91 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.461811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574c3b2-4e24-4f33-952d-210253259d91 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.462313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 197/403] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.466189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.470638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 207/404] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:46.476352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574c3b2-4e24-4f33-952d-210253259d91 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.518407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.581680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.637308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea56d9-2163-4c39-95dc-a297250970ce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.670272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574c3b2-4e24-4f33-952d-210253259d91 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.684124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.685100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.685451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.685789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.687785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.689954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a6dfb-80b8-48fd-a254-5964a44fb758 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.691907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 198/405] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.693024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.693934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.694307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.709239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.710281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.710773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.711230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.713110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.714847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.716237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:46.716968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 208/406] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.717869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.722472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:46.826103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 199/407] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:46.826103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:46.841868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe63cf-9b3e-4619-b9bb-5bfca34c29f2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.860474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.878421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:46.923295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.924311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.924762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.925218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.927344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, group_id=6ceb92d6c1404cbba5c77123146e2ba6, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.929036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.945174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843f3a-e062-4f6d-9a3d-ab64548a5fab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:46.960168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 209/408] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 24 10:29:46 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:46.986134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:46.986808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:46.987085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:46.987355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:46.988627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:46.990125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:46.991969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 200/409] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:46 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:46.997852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.111374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981568d-d3bd-42d6-86f6-e75dfa2b3c8d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:47.148344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:47.150184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.150667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.151118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.153648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34, group_id=6ceb92d6c1404cbba5c77123146e2ba6, role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:47.155497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5143e9-357b-4714-990a-b5a3d54771c1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:47.166198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.181252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 210/410] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 24 10:29:46 2022] PUT /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34/groups/6ceb92d6c1404cbba5c77123146e2ba6/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:29:47.231515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c786d-e8dc-4b5b-a635-8bb1205bdd54 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.231806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c786d-e8dc-4b5b-a635-8bb1205bdd54 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.231992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c786d-e8dc-4b5b-a635-8bb1205bdd54 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.233356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 211/411] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:47.239189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.239502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.239754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.272377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:47.274399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:47.321669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:47.330053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:47.338892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93efab2-0d6d-43e3-aded-075b30c12141 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:47.383258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:47.385043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.386109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.386725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.391227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 212/412] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:47.405093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:47.410084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:47.410949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:47.411728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 201/413] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:47.419624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.551266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49201f9-5d4e-44ee-8474-8b732d6f7683 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:47.594668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:47.595650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.596178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.596670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.597539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:47.598038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:47.599689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:47.609219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 213/414] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:47.614475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.778461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842bb6f-2b8c-4902-9dd6-88358268e7c6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:47.821772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:47.822358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.822635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.822907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] PATH_INFO: `/v3/groups/f36869b972054d27aa548a0f292c1dea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:47.824054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] RBAC: Authorizing `identity:get_group(group_id=f36869b972054d27aa548a0f292c1dea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:47.825517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:47.827343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 202/415] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:47 2022] GET /identity/v3/groups/f36869b972054d27aa548a0f292c1dea => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:47.832695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.845732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:47.872367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:47.928055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:47.956296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec925c-2f9d-4434-a5e7-42bd9e450d31 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:47.991713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:47.992347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:47.992626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:47.993429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.005194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:48.011742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:48.012655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:48.013463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 203/416] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:48.018935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:48.107609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:48.129423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932df38c-12eb-4b8b-80b7-8f50039f2641 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:48.169168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41571-ba67-4212-bbee-bd31b2513c5f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:48.192691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:48.193338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:48.193562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:48.193826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.194514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:48.194813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:48.196778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:48.216290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 204/417] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:48.221515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:48.236510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:48.237144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:48.237421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:48.237686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] PATH_INFO: `/v3/projects/4732e69892d041d9ae3567e9b16b15ff` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.238890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] RBAC: Authorizing `identity:get_project(project_id=4732e69892d041d9ae3567e9b16b15ff)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:48.240348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:48.242132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 214/418] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:47 2022] GET /identity/v3/projects/4732e69892d041d9ae3567e9b16b15ff => generated 344 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:48.253748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:48.435390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f462f6-467f-4f29-b7df-3e81a4f33709 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:48.450882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:48.453260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702678a-b4cb-433c-b90d-4ddd6bb3c80c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:48.489601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:48.490240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:48.490520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:48.490790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.506440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:48.517607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:48.518388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:48.518686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:48.519008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] PATH_INFO: `/v3/projects/4732e69892d041d9ae3567e9b16b15ff/groups/f36869b972054d27aa548a0f292c1dea/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.526184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] RBAC: Authorizing `identity:create_grant(project_id=4732e69892d041d9ae3567e9b16b15ff, group_id=f36869b972054d27aa548a0f292c1dea, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:48.527629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:48.556108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 215/419] 10.222.0.52 () {58 vars in 1442 bytes} [Wed Aug 24 10:29:48 2022] PUT /identity/v3/projects/4732e69892d041d9ae3567e9b16b15ff/groups/f36869b972054d27aa548a0f292c1dea/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:29:48.577671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:48.579363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:48.694454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 205/420] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:48.700635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:48.810008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195188-c1d6-4aff-8f7c-ea95e9c3ac0f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:48.848497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:48.849155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:48.849439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:48.849715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:48.850901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:48.852932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb29f1-f0a3-47a1-98f7-581fc1ee0805 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:48.854906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 216/421] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:48 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:48.860493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:48.922454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:48.982664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57b37b-6922-4a29-870c-add1d0e55362 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:49.004503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1d26-ffaf-4f97-ae6b-f56868c860c8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.005115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1d26-ffaf-4f97-ae6b-f56868c860c8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.005610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1d26-ffaf-4f97-ae6b-f56868c860c8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.007515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 217/422] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:49.013959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.014608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.015082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.024721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:49.025358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.025641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.025915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.027086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:49.028554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:49.030466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 206/423] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:48 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:49.036173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:49.041072 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:49.042575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:49.066714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:49.125314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 218/424] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:49.152602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b1a60-c31a-4fab-bcbf-5fd78757c355 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:49.194475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:49.210294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:49.210914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.211195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.211470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.212315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=372be1e6a7714f3cb257be56e3c00274) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:49.212625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:49.214090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286674e-2795-43cf-b8f4-a16ae8ebfd19 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:49.225176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 207/425] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:49 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:49.467724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:49.565466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414dda0-d6b6-4d70-b3e9-e23be43dd759 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.566109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414dda0-d6b6-4d70-b3e9-e23be43dd759 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.566598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414dda0-d6b6-4d70-b3e9-e23be43dd759 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.568430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 208/426] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:49.573403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe334-97a8-4c17-8112-9637af9e7c13 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.573992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe334-97a8-4c17-8112-9637af9e7c13 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.574490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe334-97a8-4c17-8112-9637af9e7c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.600470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-23dfe334-97a8-4c17-8112-9637af9e7c13 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:49.602044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-23dfe334-97a8-4c17-8112-9637af9e7c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:49.639717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa455c-b99e-4150-bef7-daff9727cbce None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:49.689245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 209/427] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:49.694858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6eeb-8b9c-4706-aceb-bd5d047e5e55 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.695139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6eeb-8b9c-4706-aceb-bd5d047e5e55 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.695408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a6eeb-8b9c-4706-aceb-bd5d047e5e55 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.697280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 210/428] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:49.698965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:49.699898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.700315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.700725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.702693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.702976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.703248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.717957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:49.726539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:49.728128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:49.728925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:49.729542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:49.729621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 219/429] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:49.729687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:49.736348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:49.771152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:49.814412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 211/430] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:49.878621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8c46-bc5f-4c09-8358-ffc983dcd71f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:49.916183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:49.916793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:49.917072 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:49.917340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:49.918001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:49.918330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:49.919701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:49.928891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 220/431] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:49.934106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:49.971915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.010673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.062744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57fbe3-ddb1-4af9-bb9e-57afee2a5be0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.109726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.111134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.111606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.112042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.112761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.143842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fd72c-da39-4b31-98aa-d9c55cf95eb0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.184609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.185251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.185536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.185968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.196624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.198136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.199982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:50.205236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:50.206191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:50.206989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 221/432] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:50.208292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.246258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.330398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 212/433] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:50.330398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.338318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9993ef-e32a-4d5d-869c-bdc8bf9c4736 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.375107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.375750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.376033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.376300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.384160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.389829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:50.394624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:50.395499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 222/434] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:50.399378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.434604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea4178-b1e4-475d-8ca2-6bf017135e14 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.472259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.472862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.473140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.473399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.474060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:50.474403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.475767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.479067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.491304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 213/435] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:50.491304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.511616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7f952-fa22-4c5c-bc31-4eedd17b204f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.550124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.550766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.551051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.551327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] PATH_INFO: `/v3/projects/372be1e6a7714f3cb257be56e3c00274` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.552466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] RBAC: Authorizing `identity:get_project(project_id=372be1e6a7714f3cb257be56e3c00274)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.553916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.555764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 223/436] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/projects/372be1e6a7714f3cb257be56e3c00274 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:50.560806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.598844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4c5f-f8c0-440c-9d1c-fe8b4eeed8e7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.629054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.635176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.636161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.636161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.636328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.636965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:50.637270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.638682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.647378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 214/437] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:50.648177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.671737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63b3e-3f37-4bdc-b928-f2598df96170 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.716178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.716860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.717144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.717423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.721618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.765313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447203a-5d33-4588-85a8-fa2350c318c8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.790594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.792157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.802383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.802883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.803163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.803434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:50.804681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:50.806178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:50.807813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 215/438] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:50.808535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.869729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.909374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 224/439] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:50.910295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:50.924685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951d70e-657d-4ba8-9239-0c7c30de244b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:50.957797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:50.965400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:50.966012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:50.966314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:50.966586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.016736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a969fb-0c1f-4e0f-b0bb-369ea6234f37 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.039021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.040888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.051896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.052506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.052780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.053048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.053770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=372be1e6a7714f3cb257be56e3c00274) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:51.054093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.056067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.062047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 225/440] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=372be1e6a7714f3cb257be56e3c00274&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:51.062867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.105254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:51.176224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 216/441] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:51.185228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.203645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bca241-85cc-4cd8-9188-aaefdda0d01c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.220666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:51.242231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.243416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.243697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.243964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.245119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.246611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.248484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 226/442] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:51.253699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.309707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47941e0-f689-4c37-a844-bda9d821b5ef None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.351115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.352015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.353457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.353876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] PATH_INFO: `/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.355539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] RBAC: Authorizing `identity:get_project(project_id=16bb6c578f6e4fad9a2f6ddb59a24a34)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.357647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.359546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 217/443] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/projects/16bb6c578f6e4fad9a2f6ddb59a24a34 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:51.365178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.374423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:51.378477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586569-f5a3-4403-8dc2-2ec7a83b2de3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.419457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.420099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.420381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.420657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.421786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.423296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.425046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 227/444] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:51.433274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.512395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:51.525312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c78-4bf9-4eb0-b856-d6bf51ce8c55 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.569203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.569750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.570030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.570474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] PATH_INFO: `/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.572288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] RBAC: Authorizing `identity:get_group(group_id=6ceb92d6c1404cbba5c77123146e2ba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.573729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.576077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 218/445] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/groups/6ceb92d6c1404cbba5c77123146e2ba6 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:51.578272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ec2dc-3fed-4beb-8727-9e1950019980 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.581773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:51.625702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.626328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.626615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.626888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.627616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:51.627931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.629377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8acbf-92c6-483a-a8f4-af9b5bdec353 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.636443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 228/446] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:51.637645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280fab-b5b9-4261-863a-8d3e71cc108c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.637940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280fab-b5b9-4261-863a-8d3e71cc108c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.638264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e280fab-b5b9-4261-863a-8d3e71cc108c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.642109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 229/447] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:51.647746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.648265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.648978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.677083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:51.679057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:51.712119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cfbed-bc42-4592-ab9c-b1d826cdd98e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:51.715758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:51.770185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 230/448] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:51.771353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:51.772145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:51.772573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:51.772993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:51.774319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] RBAC: Adding query filter params (group.id=6ceb92d6c1404cbba5c77123146e2ba6, role.id=266f2149c31e44dbae08f90e49f8ce15, scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:51.774808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:51.776460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:51.783905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 219/449] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:51 2022] GET /identity/v3/role_assignments?group.id=6ceb92d6c1404cbba5c77123146e2ba6&scope.project.id=16bb6c578f6e4fad9a2f6ddb59a24a34&role.id=266f2149c31e44dbae08f90e49f8ce15 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:52.104249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:52.214257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68561b-30e9-450c-9882-2e6f1c73eac2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:52.256762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:52.257518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:52.257885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:52.258311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:52.272099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:52.277722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:52.279416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:52.281211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 231/450] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:52.286027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:52.315296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:52.385437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c09e4-6cdb-41ff-8556-84376d966fb9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:52.418015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:52.418637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:52.418914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:52.419181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:52.419834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:52.420135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:52.421494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:52.429283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 220/451] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:52.435532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:52.457102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:52.533700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f978b-a441-4311-8eed-1c5c774709d0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:52.566665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:52.567269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:52.567551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:52.567827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:52.632798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:52.634852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:52.654623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:52.731713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 232/452] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:29:52.737688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:52.825972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:52.838513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b60d2-755b-4b54-8da2-04944415bc3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:52.872426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:52.873038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:52.873313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:52.873583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] PATH_INFO: `/v3/projects/4732e69892d041d9ae3567e9b16b15ff` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:52.874691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=4732e69892d041d9ae3567e9b16b15ff)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:52.876109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:52.877719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 221/453] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:29:52 2022] GET /identity/v3/projects/4732e69892d041d9ae3567e9b16b15ff => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:52.884205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:52.980039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d27c-bc7d-458d-8976-e2afa95dc0c7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:53.000432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:53.014424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:53.015051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:53.015347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:53.015640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] PATH_INFO: `/v3/groups/f36869b972054d27aa548a0f292c1dea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:53.016717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] RBAC: Authorizing `identity:get_group(group_id=f36869b972054d27aa548a0f292c1dea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:53.018158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e4a59-2911-4419-abb7-36d2e7127e3b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:53.019704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 233/454] 10.222.0.52 () {56 vars in 1180 bytes} [Wed Aug 24 10:29:52 2022] GET /identity/v3/groups/f36869b972054d27aa548a0f292c1dea => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:53.025893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:53.124986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6fa24-c652-4a94-9b34-fb862b838dd1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:53.157568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:53.158187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:53.158469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:53.158741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:53.159458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] RBAC: Adding query filter params (group.id=f36869b972054d27aa548a0f292c1dea, role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=4732e69892d041d9ae3567e9b16b15ff) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:53.159821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:53.161208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7483b-3085-48ea-b320-57d5323ddfb3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:53.167358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 222/455] 10.222.0.52 () {56 vars in 1376 bytes} [Wed Aug 24 10:29:53 2022] GET /identity/v3/role_assignments?group.id=f36869b972054d27aa548a0f292c1dea&scope.project.id=4732e69892d041d9ae3567e9b16b15ff&role.id=88421fc218124abeb809266ecb9668ea => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:55.428290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aed-71cf-45a2-a7ac-a423d6878ed8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:55.429310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aed-71cf-45a2-a7ac-a423d6878ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:55.429798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b56aed-71cf-45a2-a7ac-a423d6878ed8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:55.432002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 234/456] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:55.437674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37889-c186-47df-ba66-f3b399c2e1f6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:55.438557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37889-c186-47df-ba66-f3b399c2e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:55.439029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37889-c186-47df-ba66-f3b399c2e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:55.462431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b4b37889-c186-47df-ba66-f3b399c2e1f6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:55.463975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b4b37889-c186-47df-ba66-f3b399c2e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:55.483783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:55.544111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 223/457] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:55.934634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56aed-71cf-45a2-a7ac-a423d6878ed8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.073425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b56aed-71cf-45a2-a7ac-a423d6878ed8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:56.121362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:56.121934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.122243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.122517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.127350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f79e-002e-4dfa-8031-e7a144506fc1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.127866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f79e-002e-4dfa-8031-e7a144506fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.128334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93f79e-002e-4dfa-8031-e7a144506fc1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.130100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 224/458] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:56.134377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:56.135566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5000-3f67-414c-97eb-5683281341e4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.135826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:56.136286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5000-3f67-414c-97eb-5683281341e4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.136752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5000-3f67-414c-97eb-5683281341e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:56.151460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:56.152375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:56.153209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:56.153209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:56.153209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:56.153209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 235/459] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:56.161472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.178892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-71ad5000-3f67-414c-97eb-5683281341e4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:56.181090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71ad5000-3f67-414c-97eb-5683281341e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:56.238599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:56.292549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 225/460] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:56.329285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa0db-8598-4ca0-a7ee-f549ff59e7b6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.329890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa0db-8598-4ca0-a7ee-f549ff59e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.330410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafa0db-8598-4ca0-a7ee-f549ff59e7b6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.332395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 226/461] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:56.337769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43a62-5161-4dd9-be67-643a040be19e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.338380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43a62-5161-4dd9-be67-643a040be19e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.338969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43a62-5161-4dd9-be67-643a040be19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.346098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d6f9-5ca6-4d05-b538-ccbafe87dd7f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:56.373518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1ec43a62-5161-4dd9-be67-643a040be19e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:56.374958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1ec43a62-5161-4dd9-be67-643a040be19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:56.387686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:56.388310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.388587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.388856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.389506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:56.389808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:56.391203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:56.404611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 236/462] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:29:56.415605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.456197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 227/463] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:56.516244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed858-5eee-40f5-af11-8fcc1fd33650 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.516883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed858-5eee-40f5-af11-8fcc1fd33650 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.517344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ed858-5eee-40f5-af11-8fcc1fd33650 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.526173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 228/464] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:56.531741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.532274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.532737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.542090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:56.542090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97925d-5bb1-4845-8465-32c8ce3f2825 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:56.573869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:56.575109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:56.586194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:56.587249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:56.587357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.587637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.587906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.588601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:56.589972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:56.620729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 237/465] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:56 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:56.621990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.668614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 229/466] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:29:56.748532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9d19-4ae9-4a4d-8c62-b3ef8f252bd8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:56.790292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:56.791193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:56.791621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:56.792037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:56.804607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:56.806959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:56.822576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:56.823704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:56.824782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:56.824782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:56.824782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:56.826635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 238/467] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:56.832638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.872039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:56.885936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:56.977597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6951e0-a0d9-429b-9199-ada339fd4cba None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:56.991231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe198cc5-319d-46f5-a216-5e293afb8aca None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.020320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.020936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.021199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.021461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.022137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:57.022510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.024856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb57c8c-2c88-4800-9883-36d94764f9b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.032905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.033542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.033827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.034133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.036727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 230/468] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:57.037754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581db6-c30c-4533-bf79-5b02dd0404e7 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.038040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581db6-c30c-4533-bf79-5b02dd0404e7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.038347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581db6-c30c-4533-bf79-5b02dd0404e7 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.042114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 231/469] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:57.042114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581db6-c30c-4533-bf79-5b02dd0404e7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.044956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.051014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.052508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:57.068668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:57.069563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:57.071031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:57.071031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:57.071031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:57.071031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 239/470] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:29:57.071031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.132456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.159606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581db6-c30c-4533-bf79-5b02dd0404e7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.182940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa35612-ab0c-41c6-99b1-de3a652e49bb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.197452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.198190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.198463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.198742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.209517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.211050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.218051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.218693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.218976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.219245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.219884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.221293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f6dfc028-fcd2-482d-a8e2-5e2fc2dae63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:57.227137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:57.228198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:57.229212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:57.229212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:57.229212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:57.230628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 232/471] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:57.232155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.232570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.233021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.248140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 240/472] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:57 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:57.248974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.265586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:57.267217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:57.346121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.372794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 233/473] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:57.374943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.402702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6943a-b160-45a8-88c8-8c8d8b60594a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.420816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.457107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.458120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.458712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.459199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.460061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:57.460559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.462192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.475898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 241/474] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:57.486937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.524106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74e039-483c-47d0-bdc0-12589375f85e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.563391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.563996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.564270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.564538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.565406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:57.565512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.566881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.580514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 234/475] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:57.586192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.623688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6483ba-58a0-4920-91be-ee9fa356d5e3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.646137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.688423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.689037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.689315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.689586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.690262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.691693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.718909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 242/476] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:57 2022] POST /identity/v3/users => generated 249 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:29:57.719990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:57.740843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2afe0f-4d38-423c-9b21-2543aa48bf23 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.790974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:57.823554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.826142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.826678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.827169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.829297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.831316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.871453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 235/477] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:29:57 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:29:57.935389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4ce3-3eb1-40cf-857b-7a33a116af01 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:57.977844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:57.978592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:57.978876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:57.979200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:57.979906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:57.981396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:57.999545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.sql.core [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:29:57.999545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:29:57.999545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [parameters: {'id': 'c05b6c37438f4c8ca44e04fe09f0c15e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:29:57.999545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81677) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 24 10:29:58.018816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:29:58.019766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application yield resource Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise self.value Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application session.commit() Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:29:58.020883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:29:58.021763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:29:58.022650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:29:58.024157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [parameters: {'id': 'c05b6c37438f4c8ca44e04fe09f0c15e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:58.024946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 10:29:58.025714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:29:58.026579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 243/478] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 24 10:29:57 2022] POST /identity/v3/roles => generated 144 bytes in 301 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:58.031008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:58.149103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:58.152829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386939a-4cf3-4211-95d9-bfcca5baa708 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:58.191663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:58.192296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:58.192575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:58.192841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:58.203607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8c776b89-c797-4537-a8fd-410eac7534c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:58.208850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:58.209729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:58.210972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 236/479] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:58.216050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:58.322577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:58.324786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c27ce2-f515-48c2-927e-a2eed7a67a2a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:58.362095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:58.362732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:58.363017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:58.363294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:58.363967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:58.364271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:58.365720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1ae01-5fcb-4231-93c9-d03f641ec387 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:58.374979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 244/480] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:29:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:58.856601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c38d-2c52-45f7-b975-5f9302239bfd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:58.857137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c38d-2c52-45f7-b975-5f9302239bfd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:58.857224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86c38d-2c52-45f7-b975-5f9302239bfd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:58.858754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 237/481] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:29:58.864516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:58.864924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:58.865126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:58.895040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:58.896256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:58.965660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 245/482] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:29:59.362176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c38d-2c52-45f7-b975-5f9302239bfd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:59.496353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86c38d-2c52-45f7-b975-5f9302239bfd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:59.546768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:59.547675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:59.548097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:59.548507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:59.564796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:29:59.570142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:59.571791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:29:59.572764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:59.574671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 238/483] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:29:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:59.580881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:59.726474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:59.738578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59109d31-63fb-47a5-b417-f1b87e6c89d4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:59.775047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:59.775654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:59.775933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:59.776206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:59.776860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:29:59.777159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:59.778560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080425cf-1759-4573-93f4-3ce603ad736c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:59.786616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 246/484] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:29:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:29:59.795110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:29:59.807272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a087cd-6473-4d0f-91c4-8ffc510b8a57 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:59.807564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a087cd-6473-4d0f-91c4-8ffc510b8a57 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:59.807839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a087cd-6473-4d0f-91c4-8ffc510b8a57 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:59.810311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 247/485] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:29:59.815184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:59.815469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:59.815745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:59.830184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:29:59.854820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:29:59.856035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:29:59.913138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987d6bf-9fa2-49a7-8cd5-1bf55a1abc38 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:29:59.948953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:29:59.949604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:29:59.949875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:29:59.950164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:29:59.960915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:29:59.962453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:29:59.977737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:29:59.978709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:29:59.979770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:29:59.979770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:29:59.979770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:29:59.979770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 239/486] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:29:59.987203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.069271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.083730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 248/487] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:30:00.102586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913da6fb-d23b-411e-9ebd-80cd70f0c9b6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.155344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.156193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.156668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.157080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.157882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:00.158358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:00.159868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457a0e-dd2f-49f7-a02d-ba05dbfde875 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:00.177398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 240/488] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:00.183851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.245960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf75-aed1-45bb-8bb9-83a9ef40d7c9 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.246552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf75-aed1-45bb-8bb9-83a9ef40d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.247190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf75-aed1-45bb-8bb9-83a9ef40d7c9 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.248903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 241/489] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:00.255643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.256127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.256809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.279792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:00.281242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:00.328820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.364575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fc578-2bae-4098-a024-3380dd257e1a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.405825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 242/490] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:30:00.429589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.430563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.430991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.431414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.433285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.447438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:00.448916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:00.472634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:00.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:00.474526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 249/491] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:00.486659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.534582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.609039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5d95b-054e-4966-8387-1c0d4e0e2832 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.653930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.654613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.654884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.655148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.660053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3aed1-daf2-4d24-8e36-17735b6301ca None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.665660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-725ceddf-d09a-4c0e-99a7-c456c7ae017f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:00.670461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:00.671333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:00.672114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 243/492] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:00.673318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9768-054e-4762-9124-3d91eec5e70a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.673629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9768-054e-4762-9124-3d91eec5e70a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.673717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9768-054e-4762-9124-3d91eec5e70a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.678090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 244/493] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:00.678090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df9768-054e-4762-9124-3d91eec5e70a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.708938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.710015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.710343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.710625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.712219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:00.712526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:00.714920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d572-a266-412b-97c0-3dd353abe373 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:00.750509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.766474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 250/494] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:00.768025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.768375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.768721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.786986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:00.788094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:00.793314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df9768-054e-4762-9124-3d91eec5e70a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.819329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:00.837401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.838126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.838455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.838709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:00.839383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:00.840053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:00.841069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:00.850228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 245/495] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:00.850908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.869937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 251/496] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:00.871337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:00.961989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cc37-38d9-4815-bea9-58f41859b96d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.985439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757acf-776d-4bdb-9031-1f0b2e4d323d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:00.995960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:00.996578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:00.996850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:00.997114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.008934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:01.013615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.014564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:01.015357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:01.015946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.016015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 246/497] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.016015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.026427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.027172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.027516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.027869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.067109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.098616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.100080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.126255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328ca40-b3bb-4a3d-bce6-d1780cc7802d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.161873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.162513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.162787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.163056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.172714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.174207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a1b00fc2-3076-48ec-88f9-cbddd9400e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:01.188230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.189149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:01.189972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:01.189972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.189972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:01.189972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 247/498] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.190481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645678-ae28-4105-a1a2-5629f6b9d12d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.190749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645678-ae28-4105-a1a2-5629f6b9d12d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.190953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645678-ae28-4105-a1a2-5629f6b9d12d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.192159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 248/499] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:01.192842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645678-ae28-4105-a1a2-5629f6b9d12d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.202233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 252/500] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:01.203384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.233239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.294824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.301812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645678-ae28-4105-a1a2-5629f6b9d12d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.303477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fe02a-517e-4ea9-8b45-3fe584142e49 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.334588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.335123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.335418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.335684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.336887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:01.337188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.338177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.338606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.338802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.339086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.339359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.347082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 249/501] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:01.347874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.349303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-298f514d-932f-4c4b-a459-805682963de5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:01.354136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.355214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:01.356028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 253/502] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.356698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.357354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.357460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.374487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:01.375685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:01.444837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 254/503] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:01.446210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.451857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb362a-811a-4fa3-bb87-0f4c73412149 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.470117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.486399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.486998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.487268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.487530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.488165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:01.488460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.489808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.501699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 250/504] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:01.502535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.525775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.557011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6b5cb-6803-4896-844e-cb9ca55f87e9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.591374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.591936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.592219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.592493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.604212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.605654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.616096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45437be4-94c4-466d-8974-12ae2843cc4c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:01.620079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.620950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:01.621775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:01.621775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.621775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:01.625759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 255/505] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.626471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.655165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.655854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.656134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.656408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.667736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.669178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:01.685770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.686739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:01.687557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:01.687557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:01.687557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:01.687557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 251/506] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.687777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.702800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.735279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f8c03-c038-44cb-af0b-be69440eb7e0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.757406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.769646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.770288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.770568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.770838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.771496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:01.771796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.773163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.781106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 256/507] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:01.781880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.790129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcc1bc-0f7f-4a75-baaf-fb51daa95cb4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.822935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.823578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.823873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.824161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.831671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.833223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:01.846017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:01.846929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 252/508] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:01.847815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.884638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067bfd-2a85-49c9-b306-a1aa7016b592 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.912532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.918573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.919184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.919463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.919736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.920382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:01.920684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.922101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:01.934601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 257/509] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:01.935392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:01.950615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c2e5-9a11-451f-b358-44056909f701 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:01.980240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:01.986406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:01.987001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:01.987276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:01.987553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:01.988186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:01.988487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:01.989885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.001994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 253/510] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.002798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.038275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44837b-08f6-48b3-8f78-fcb410c6a038 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.072326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.072946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.073223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.073491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.083112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.084550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:02.098754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:02.100054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:02.100896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:02.100896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:02.100896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:02.100896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 258/511] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:02.101115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ccf1-8497-44b6-975d-503fe2d2278e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.101193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.137457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.138113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.138421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.138718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.147800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.149404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.151145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:02.165602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:02.166803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:02.167632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:02.167632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:02.167632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:02.167632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 254/512] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:02.167632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.205987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b781f6-a7c0-4fe4-992a-cf4cd1a59c4d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.214093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.239839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.240444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.240724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.241001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.241726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:02.242032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.243988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.261011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 259/513] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.261812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.271714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8611-3521-4f4d-8442-91b16a9db0e6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.306205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.306821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.307105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.307377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.313873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.315354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:02.327109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:02.327954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:02.328811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 255/514] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:02.329301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.366475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ccd2-d75b-471c-87b8-1450b30efd30 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.367959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.400965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.401608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.401903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.402209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.408960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.410422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:02.422573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:02.423671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 260/515] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:02.424683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.432043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4428412-b27a-4f8b-8a29-4a7399938a5d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.433695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.467016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.467616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.467894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.468166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.468799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:02.469102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.470532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.482890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 256/516] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.483730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.524338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f00752-94b3-410b-bfcd-777ab04e43c4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.557017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.557617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.557898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.558205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.558855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:02.559163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.560542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.572307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 261/517] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.573148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.583635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f2e3-505e-4ad9-b223-90212201d9b2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.599541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.617545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.618106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.618389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.618657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.647990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.674088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278ee9-9eaa-4a1c-8ba1-cba6c37995aa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.687068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.688562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.708402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.708999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.709274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.709541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.710264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:02.710570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.711973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.731149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 262/518] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.732457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.790790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 257/519] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:02.791738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.816341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.839717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc3336-5401-4ee9-9669-67829c337d37 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.855685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:02.875526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.876066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.876341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.876610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.877328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:02.877743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.879276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.895503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48509def-9bcb-4114-a160-59b7c93c7793 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:02.895781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 263/520] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:02.896928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:02.929563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:02.930814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:02.931089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:02.931351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:02.931976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:02.933440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:02.953452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 258/521] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:30:02 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:02.954113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.018676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854b1f1-e3d1-4919-9df4-ff5d273ca23b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.060003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.060657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.060969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.061248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.069509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.071006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.074500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.075862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebd056-941b-4113-ba54-b99ca1537e02 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:03.084889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:03.085877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:03.087681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 264/522] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:03.088252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.104679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.123968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.124570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.124851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.125113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.125884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:03.126198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.127636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.135221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 259/523] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:02 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:03.136048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.237400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af73f8-0b89-4864-bb7d-e8ddc1a95387 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.279699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f140-6733-4f86-95ad-c27ec186a7a5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.279913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.280462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.280749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.281725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.295076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.296593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:03.319037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:03.320213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:03.321583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:03.321583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:03.321583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:03.324874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.325588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.325701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 265/524] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:03.326035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.326432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.326560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.391288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.406516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.416002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.418534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.459882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30c81f-88c9-4d70-9907-90b93f63270a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.509469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.510389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.511230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.511830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.512885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:03.513352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.515995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.535868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 260/525] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:03.536945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.541929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 266/526] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:03.542986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.635753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.657621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271bab-b76d-4100-854f-d6f778a98dea None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.675500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c4090-1cfc-4765-8ec0-c334ef28d907 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.690616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.694909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.695895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.696144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.696556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.697298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:03.697700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.699281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.712047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 261/527] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:03.712955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.720423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.721237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.721666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.722103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.735569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.737198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:03.756095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:03.757221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:03.758328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:03.758328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:03.758328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:03.760166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 267/528] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:03.761106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.839002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f392d-1290-4120-b3d5-2ea3699634a1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.881045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6118c2-58e6-4dc4-853d-9a32efa2c7bb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:03.881598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.882405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.883108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.883526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.902769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:03.932077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:03.932954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:03.933247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:03.933528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:03.942590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.944843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:03.962462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:03.963333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:03.964181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 268/529] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:03.965097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:03.973216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:03.975058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:03.997959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.103798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 262/530] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:04.111534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.125927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e6a4c-84b0-410a-9c6a-3421588d9cc4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.184441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.189633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.190644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.191121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.191602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.192899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:04.193422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.197192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.220547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 269/531] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:04.222290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.269771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c171e1-3826-4e18-932f-e1a5f913c8f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.308319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.309287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.309763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.310277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.311271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:04.311818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.313489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.333310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.334600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 263/532] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:04.335725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.357655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc18c-7dfe-4a41-8084-2259a078f1fc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.394438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.395453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.395933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.396449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.407956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.409775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:04.424841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:04.425749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:04.426635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:04.426635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:04.426635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:04.428365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 270/533] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:04.429331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.457193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58814803-f8b9-44d6-be6b-f3c560e721ae None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.459729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.511059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.511691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.511969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.512240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.521127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.522794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:04.534986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:04.535878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:04.536741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 264/534] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:04.537847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.574764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a5ce-615a-42b0-beb7-579c6c2343d9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.611773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.612382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.612665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.612942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.613804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=273e5c26e347484d84b6b1b196b11282) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:04.613982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.615445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.617427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.622374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 271/535] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/role_assignments?user.id=273e5c26e347484d84b6b1b196b11282&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:04.623144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.682351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1aeb5-f036-4c15-8034-22b9ff623c97 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.719616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.720305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.720680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.721047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.721936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:04.722221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.723709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.737350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 265/536] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:04.746094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.770556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4e615-2cc5-49ba-a48b-7481814633ce None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.809582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:04.810227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:04.810849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:04.810958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:04.811652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:04.811964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:04.813412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:04.817209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.828514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 272/537] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:04.836187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:04.916670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:04.963760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b6b-6857-4c38-8e3a-3a48aa5fd9f4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:04.984158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bd8cc-1aee-4e08-810b-a6eaf4b8bfa5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.007240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.009042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.009515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.009945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.010827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=479086935d3f440599d314c210cdb44a) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:05.011394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:05.013694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ec4e4-101e-4405-9574-597fee164ae0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:05.021452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 273/538] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/role_assignments?user.id=479086935d3f440599d314c210cdb44a&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:05.023856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b30-a3d5-43ef-8d7a-f73505f82b0a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.024312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b30-a3d5-43ef-8d7a-f73505f82b0a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.024727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6b30-a3d5-43ef-8d7a-f73505f82b0a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.026462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 274/539] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:05.031000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.032754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.033037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.033307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.034970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.035477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.035967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.045737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:05.047329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:05.056269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:05.057886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:05.060836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:05.061880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:05.063139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:05.064292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 266/540] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:05.070123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.160940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:05.184935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 275/541] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:05.186929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481b10a-6f35-443d-9736-d928899a8e89 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.223165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.223823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.224099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.224364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.225046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:05.225346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:05.227369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb67a34-21ed-48bf-90fa-46087527df7b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:05.239585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 267/542] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:05.245459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.259762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b74f-871a-4ae5-b314-7b2b84f9692e None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.259762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b74f-871a-4ae5-b314-7b2b84f9692e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.259762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114b74f-871a-4ae5-b314-7b2b84f9692e None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.260448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 268/543] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:05.269070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.269348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.269620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.293542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:05.294802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:05.366963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:05.415357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 269/544] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 10:30:05.462610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4a40f-b14f-44fe-9116-6f49a36a6932 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.505562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.524261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.524874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.525149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.525417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.527389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=c648572b085545719bd8b6f1dcdf1a85) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:05.527704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:05.529153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:05.544717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 276/545] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/role_assignments?user.id=c648572b085545719bd8b6f1dcdf1a85&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:05.603327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:05.630522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee5650-c4bf-4fa5-bfb7-24786aa7ccee None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.668783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.669421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.669798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.670083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.681877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:05.686711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:05.687594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:05.688679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 270/546] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:05.695284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.704899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.851374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb36dc-92d0-4ae1-89b3-d1bd3df6206d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.863953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e0421-a7dd-4eb7-b333-23366de6373e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:05.896731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:05.898005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:05.906118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.906762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.907034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.907298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.918783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:05.924017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:05.924883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:05.925864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 271/547] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:05.933103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:05.953196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:05.954198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:05.954674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:05.955137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:05.955993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:05.956521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:05.958143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:05.968234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 277/548] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:05.974087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.147321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7711c5-d2db-4685-ad48-134577567976 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.173010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78b10-99da-4c59-b6f1-bfdfeb07c506 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.227369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0624-6053-4b42-817b-5e154804403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.228026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0624-6053-4b42-817b-5e154804403b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.228258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0624-6053-4b42-817b-5e154804403b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.228527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0624-6053-4b42-817b-5e154804403b None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.228849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.229194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f0624-6053-4b42-817b-5e154804403b None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:06.229505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f0624-6053-4b42-817b-5e154804403b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.230353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.230823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.230936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f0624-6053-4b42-817b-5e154804403b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.231385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.242611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.244404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.256186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 272/549] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:06.260074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:06.261726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:06.263097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:06.263097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:06.263097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:06.265186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 278/550] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:06.265888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0624-6053-4b42-817b-5e154804403b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.272084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.329375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:06.350915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:06.415687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0624-6053-4b42-817b-5e154804403b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.456434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d332cc3-1e98-4e87-9ed1-1139933e3e05 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.476094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.477252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.477532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.477796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.496913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.498398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.520102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.520708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.520988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.521318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.521974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:06.522300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.523964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:06.526238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:06.527156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:06.528544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:06.528544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:06.528544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:06.528544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 273/551] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:06.537872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.550982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 279/552] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:06.558142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.663590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:06.672369 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39725c0-6453-4710-9c1c-f96894e72a40 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.711898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.712539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.712859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.713099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.720861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.722334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:06.736177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:06.737149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:06.738498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 280/553] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:06.746017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:06.765163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f975c50-01f8-4546-bc48-73c4c53f267b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:06.777190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:06.828942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:06.829596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:06.829881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:06.830181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:06.830879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:06.831181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:06.833428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:06.860718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 274/554] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:06.867853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.019360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230e34-1ceb-403e-937a-be8d459e50e5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.033609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160061f2-ae42-4629-bf6c-b8e631ad26d2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.082297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.082969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.083243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.083505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.098094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.099566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.106898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.107521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.107803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.114085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.114085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:07.114085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.115514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b324007-cf65-46e5-9c98-b5998075a524 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-dd15ceed-4a1b-4da7-ad24-76e41dcd8220 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:07.125999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:07.126941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:07.128354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:07.131523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 275/555] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:07.135611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d304-9b01-42b9-baf0-148f604879ff None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.135611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d304-9b01-42b9-baf0-148f604879ff None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.135611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d304-9b01-42b9-baf0-148f604879ff None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.141785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 276/556] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:07.142896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d304-9b01-42b9-baf0-148f604879ff None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.154372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 281/557] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:07.155674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.158179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.162091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.197902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:07.199163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:07.201139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.206381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.307975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 282/558] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:07.308143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d304-9b01-42b9-baf0-148f604879ff None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.308558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.344192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.345183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.345683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.346186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.347214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:07.347766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.349531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e031-ad42-491f-8764-3328b8bc011d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.392440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 277/559] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:07.394118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703905f6-1f00-4ff2-8762-22e0c258455c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.394996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703905f6-1f00-4ff2-8762-22e0c258455c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.395472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703905f6-1f00-4ff2-8762-22e0c258455c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.398675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 278/560] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:07.399716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703905f6-1f00-4ff2-8762-22e0c258455c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.482316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44e2c3-48a8-4af5-aebc-d538cb6e4b94 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.525287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.525889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.526478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703905f6-1f00-4ff2-8762-22e0c258455c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.526604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.526803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.527077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.536042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.567758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.568759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.569237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.569704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.581668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.583596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bcbc8cfa-1c75-49e2-b066-2a377cc83726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:07.599569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:07.600539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:07.601411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:07.601411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:07.601411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:07.601411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 279/561] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:07.602612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.602612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.602612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.607312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.608758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.620768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:07.621971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:07.702094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 280/562] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:07.702094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.722232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 283/563] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:07.723184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.771185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.777984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:07.822779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404832-9ec4-4691-b76a-8bfb01f1b82e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.853535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9220f7-e9f9-4ef9-9898-94dd2f7c7995 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:07.862107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.863094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.863590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.864048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.876648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:07.883969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:07.885009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:07.886028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:07.887384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 281/564] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:07.888270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.896133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:07.896742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.897025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.897709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.899216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:07.899526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:07.901574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0260a-a376-41df-a313-7dd5ae718a5b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:07.917400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 284/565] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:07.918482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca9c2-189c-4a83-a969-1af1f3fc30cf None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:07.918767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca9c2-189c-4a83-a969-1af1f3fc30cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:07.919041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca9c2-189c-4a83-a969-1af1f3fc30cf None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:07.924340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 285/566] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:07.924340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca9c2-189c-4a83-a969-1af1f3fc30cf None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:07.999120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093892d2-4dcd-4640-ac81-3ec437bcd858 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.021812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.025774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.028005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca9c2-189c-4a83-a969-1af1f3fc30cf None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.035277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.035900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.036175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.036449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.046961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.048416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.060722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.061318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.061597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:08.061850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.062932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:08.063962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:08.063962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:08.063962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:08.064151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.064151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:08.064151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.064323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 282/567] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.064323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.064459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277c7e-1cf4-421a-9b04-a56dca631e6f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.075885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 286/568] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:08.077005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.077292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.077566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.094556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:08.095738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:08.161670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 287/569] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:08.162479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.169766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f14a7-9138-4636-b3d5-47f214e18bfa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.204859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.205476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.205751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.206019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.214558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.216003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:08.228363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.229280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 283/570] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.230763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.265702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.276425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50669b08-3f35-4440-8ac0-f871ec3c2aa9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.277266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.313577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.314289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.314571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.314852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.325494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:08.330265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.331324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 288/571] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.332157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.348002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e139-196b-4536-bbb9-4edcd07b9e13 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.387420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.388019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.388291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.388553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.389183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:08.389479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.390865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.404264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 284/572] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:08.404978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.446662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc18c-6ea4-455a-95aa-e985d08257c5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.480065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.480691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.480967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.481240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.490861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.492973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.500988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.505617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4effb0a-dc9a-4527-ac02-6738bb466831 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:08.507697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.509179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:08.510053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:08.510053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:08.510053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:08.510053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 289/573] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.510355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.513266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.543366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.544244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.544542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.544809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.545493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:08.545799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.547294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.559191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 285/574] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:08.560056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.613220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a558abb-8cef-40be-84cd-8dcaba4803ce None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.646629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.647234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.647517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.647793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.648735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:08.649039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.650430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.657818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beaac7-1098-4f71-b420-dbb3fcb6b026 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.662663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 290/575] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:08.662663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.691462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.692078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.692351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.692619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.699610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.701042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:08.711877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.712927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:08.713812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 286/576] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.714390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.727724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.733619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.765863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d0fb-bbf3-4e9a-ab9a-c3191da7eac5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.800387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.801031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.801309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.801591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.813608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:08.817335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c794a27-209b-4d39-9274-6b4f673839ba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:08.819018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:08.819954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:08.820789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 291/577] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:08.821483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.853681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.854319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.854597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.854866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.855498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:08.855822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.857190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:08.869527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 287/578] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:08.870298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:08.934020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86286f-5856-4891-bf6f-26b630151125 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.959668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.962922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:08.971532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:08.972200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:08.972484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:08.972757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:08.985577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c131623-0341-4655-bcf4-8348effddccf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:08.987445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=f3a5ff3f106248c4ae80b6bc74e0d8f2, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:08.988877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.001904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 292/579] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:08 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:09.003298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.022392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.023423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.024362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.024636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.036039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.037528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:09.054477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:09.055499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:09.056365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:09.056365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:09.056365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:09.060665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 288/580] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:09.061423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.142830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da2df-fbbd-492a-8795-158d26973b4f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.177015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11646271-d36d-490c-9050-97730ee0e842 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.180141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.180761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.181042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.181317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.182018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.182356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.183788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.198227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 293/581] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.198227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.207535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.214585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.215190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.215465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.215729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.216390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.216681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.218051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.226463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 289/582] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.231782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.240005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.315928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef7f85-4a09-4de8-8908-0c245afc008a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.341039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb10f2-04b9-444f-9aeb-7b48cf7daeba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.357494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.358162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.358444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.358720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.366865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.368475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.375708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.376307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.376584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.376852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.377490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.377789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.379186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:09.379856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:09.380761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 294/583] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:09.387099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.405345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 290/584] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.406211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.462757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.490935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.499535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb0ec8-ecf9-4d43-8efa-186c75fad846 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.519705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a118c27-95e2-48c0-88b8-6690d708f8f4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.538095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.538717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.539050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.539367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.540114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=486dd7c41a60456892803f8acbb5e36e) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.540420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.541848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.547365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 295/585] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/role_assignments?user.id=486dd7c41a60456892803f8acbb5e36e&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.548170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.570981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.571663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.572023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.572444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.584563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.586298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:09.604724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:09.606052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:09.607204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:09.607204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:09.607204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:09.608191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 291/586] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:09.609144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.724156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7cf5-854c-423e-8766-fb125e1dbdbe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.747417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272de7-c32f-48a6-93c0-f13d5b5b9c0d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.750396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.771074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.771721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.772003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.772279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.773026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.773630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.775605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.792217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.793193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.794263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.794743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.798223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 296/587] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.799375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.808761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.810571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.824160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:09.827432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:09.828354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:09.830085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:09.833235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 292/588] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:09.835023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:09.933573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17abf-b9db-4795-8622-8000b75d640b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.966794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad734d8d-10d1-4940-b025-c6f569a3cac6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:09.969266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:09.970149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:09.970677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:09.971147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:09.972278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:09.972791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:09.974466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:09.989313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 297/589] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:09.990512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.011390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.012027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.012304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.012572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.024812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.027401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:10.043681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.044677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:10.046197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:10.046197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.046197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.046197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 293/590] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.046197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.066798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.092281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.124742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9202a-7d5a-4b21-8d7a-f3e28b0af297 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.156093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed02b-20bf-4890-a51b-481772bddc78 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.169346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.170643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.171397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.171913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.173017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:10.174035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.175774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.194238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.194238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.194238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.194238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] PATH_INFO: `/v3/users/glance` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.200636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.206311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 298/591] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 24 10:30:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:10.206311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.206831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:10.218872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.219828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:10.220743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.223338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 294/592] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.224370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.303695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.307437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1640-411a-40e2-bbcb-c53d7f863c51 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.330646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df74905-53d7-4278-8a36-099092eeeeee None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.345365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.345982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.346290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.346563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.347209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:10.347509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.348982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.350527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.362807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 299/593] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:10.363566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.370303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.371210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.371720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.372192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.384000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.386161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:10.409381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.410422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:10.411304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:10.411304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.411304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.417814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 295/594] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.419043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.474632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b489c-400c-4a44-90a1-87f836a84562 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.511692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.512352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.512562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.512826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.513550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:10.513852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.515389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.525234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c941-4a89-4668-939b-3874283f514d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.534114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 300/595] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:10.535058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.552980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.562540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.563276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.563638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.564010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.572063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.573519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:10.585015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.585951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.586874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 296/596] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.587355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.604398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.657754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f486a8-5890-4f14-9c22-d38fa8fefc95 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.693815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda40f1b-1c98-4964-81cf-334a26459591 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.696969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.697908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.698432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.698905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.699809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:10.700326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.701911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.715024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 301/597] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:10.716121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.736504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.737132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.737413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.737685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.749079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.750586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:10.766471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.767481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:10.768409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:10.768409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:10.768409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.772352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 297/598] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.773603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.819207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.831040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef8228-ff54-48f0-b75b-7fa40d7d71f1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.844855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:10.868067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.869078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.869563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.870036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.870955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:10.871461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.873135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.884332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eca846-87fe-4b07-836d-2f01c1399444 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:10.891042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 302/599] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:10.892152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:10.921194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:10.921825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:10.922134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:10.922516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:10.930539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:10.932055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:10.944357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:10.945305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:10.946221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:10.950249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 298/600] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:10.951463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.000289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d8b4e-fbfe-4cc1-9fec-80fe70b9d89c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.037301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.038031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.038428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.038775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.040030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:11.040441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.041889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.053511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 303/601] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:11.054567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.072558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.076093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc4234-c6fe-4aa2-ba42-1c950a27e264 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.092778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.114923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.115575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.115853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.116130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/273e5c26e347484d84b6b1b196b11282/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.133054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=273e5c26e347484d84b6b1b196b11282, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.134631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34098-919f-41ed-bb83-8255de3fdaab None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.147560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 299/602] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:10 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/273e5c26e347484d84b6b1b196b11282/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:11.148945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1dd1-2249-4d9e-a085-5b954a73ddbf None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.149300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1dd1-2249-4d9e-a085-5b954a73ddbf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.149642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1dd1-2249-4d9e-a085-5b954a73ddbf None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.155709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 300/603] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:11.155709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1dd1-2249-4d9e-a085-5b954a73ddbf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.198104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228f930-7a50-47e8-9e39-758ee0427625 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.239164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.239793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.240076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.240351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.241075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:11.241385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.243097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c53f2b-2649-4785-a4a3-1845cea6cf58 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.262559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 304/604] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:11.264378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.264891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.265361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.290964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:11.292520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:11.311388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1dd1-2249-4d9e-a085-5b954a73ddbf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.353449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.353934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.354245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.354514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.370102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.370102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:11.376914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:11.378621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 301/606] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:11.379700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.381809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 305/606] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:11.391146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.411606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.421865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.509055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34bf63-c6cd-44ca-94ca-cb00495513a2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.553047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.553865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.554296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.554575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.556185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:11.556496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.557922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8560a4-e8a9-49f6-9831-4f4acd91d559 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.571733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 306/607] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:11.577269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c34108-ad10-4aad-b265-7765e4250a3e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.577556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c34108-ad10-4aad-b265-7765e4250a3e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.577830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c34108-ad10-4aad-b265-7765e4250a3e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.580220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 307/608] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:11.580915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c34108-ad10-4aad-b265-7765e4250a3e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.614427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffd29-c19d-4b96-b587-b86f91ea95e2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.658952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.659730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.660004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.660356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/479086935d3f440599d314c210cdb44a/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.678707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=479086935d3f440599d314c210cdb44a, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.682181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd518f8-f71d-4474-9612-c91f014e991b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.684465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.698637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 302/609] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:11 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/479086935d3f440599d314c210cdb44a/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:11.700010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.700292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.700568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.711794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c34108-ad10-4aad-b265-7765e4250a3e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.729283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:11.730669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:11.752175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.753290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.753772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.754289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/c648572b085545719bd8b6f1dcdf1a85/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.771732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=c648572b085545719bd8b6f1dcdf1a85, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:11.774426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:11.790457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 308/610] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:11 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/c648572b085545719bd8b6f1dcdf1a85/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:11.792002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:11.809470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.824610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 303/611] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:11.939827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84182bf-ad39-46c5-a000-e974c1819119 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:11.972528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:11.977589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:11.978281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:11.978548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:11.978817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:11.990641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:11.995890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:11.996826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:11.997662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 309/612] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:12.003208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.115389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90216-90d4-423a-b119-e8ea0e046e0d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.135701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.154644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.155630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.156111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.156595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.157476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:12.157980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:12.160149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:12.171089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 304/613] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:12.178682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.272737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:12.319213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542d694-336d-4b7d-8320-b95d2232f976 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.371065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602072-8f2b-4974-b8f2-27a1ebe753c2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.387354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.388055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.388337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.388604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.409305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.409945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.410261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.410525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.419173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:12.420638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:12.422135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:12.426944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:12.427882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:12.428714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 310/614] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:12.434705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:12.456093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:12.457102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:12.457987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:12.457987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:12.457987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:12.460311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 305/615] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:12.470989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.511256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:12.567947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33fee5-a684-4284-8715-decf8bbb10f9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.618180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.619801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.620431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.622137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.623813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:12.627047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:12.628596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:12.644758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 311/616] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:12.651341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.742610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c032dd-b4e5-4f5e-9693-6e8b934fdb3d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.745261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:12.818195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.818195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.818195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.818195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.818576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:12.818576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:12.820487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:12.840563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 306/617] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:12.849240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:12.886090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb945807-aed4-4726-850d-4d6b45038efe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:12.918102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:12.959666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:12.960303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:12.960576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:12.961383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:12.993371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:12.995966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:13.029055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:13.030030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:13.030923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:13.030923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:13.030923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:13.030923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 312/618] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:13.035869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:13.072974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829784f4-f8c9-4d0e-83db-7bdea7906f20 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.133362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.133939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.134242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.134513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.178989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.180872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:13.218092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:13.219135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:13.220243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:13.223945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 307/619] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:13.231597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:13.242639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886b21a-c96e-4ed0-b486-143797bee7e9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.293074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:13.319593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.321274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.321717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.322180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.323062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:13.323527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.325074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.359038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 313/620] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:13.361255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:13.423405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:13.451701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aadd9e-14f5-4f05-9760-613e8a2f1bb5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.532060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.532680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.532957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.533222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.533960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:13.534317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.540074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51c363-8c02-47b5-9933-abc48f14d3c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.567694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2595f-027f-4d75-96e7-f36973711920 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.582901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 308/621] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:13.584195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8aa6-55c8-491e-80ec-65d987c97851 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.584483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8aa6-55c8-491e-80ec-65d987c97851 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.584757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8aa6-55c8-491e-80ec-65d987c97851 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.590537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 309/622] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:13.591316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8aa6-55c8-491e-80ec-65d987c97851 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:13.651998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.653327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.653824 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.654394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.664125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.666279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-031f6d59-d987-4097-92c9-ff0cba4ad9ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:13.683004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:13.684143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:13.685284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:13.687907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 314/623] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:13.689275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.689694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.690120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.714120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:13.716041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:13.721847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:13.746479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8aa6-55c8-491e-80ec-65d987c97851 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.788495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.789739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.790095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.790465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.805540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 315/624] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:13.806682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:13.824645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:13.867812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.869475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.925878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987e0f0-14d6-44b5-a493-95731051ae11 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:13.962335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:13.963272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:13.963710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:13.964147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:13.965043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:13.965516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:13.967143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:13.987415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 316/625] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:13.997757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.005303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.028393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 310/626] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:14.033940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.116225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.144284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce514549-9bf7-404b-b3c0-e583bd0f9d56 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.169144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9bfdc-41a3-48f7-87e2-67611ad2d65a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.184190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.185173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.185598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.185929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.196548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.197985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.207744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.208368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.208644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.208911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fd944446-1fdf-44bb-be0e-4d4a82a1b97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:14.212433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:14.213557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:14.214560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:14.214560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:14.214560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:14.214560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 317/627] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:14.214819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584931-b7bc-4f8b-80b1-805ea00fecfe None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.215417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584931-b7bc-4f8b-80b1-805ea00fecfe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.215417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584931-b7bc-4f8b-80b1-805ea00fecfe None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.218136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 318/628] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:14.218136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d70bb-a5f6-4f71-9aeb-c56d43c471d2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.218136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d70bb-a5f6-4f71-9aeb-c56d43c471d2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.218136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d70bb-a5f6-4f71-9aeb-c56d43c471d2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.219317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 319/629] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:14.219877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d70bb-a5f6-4f71-9aeb-c56d43c471d2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.224032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.225571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:14.239989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:14.241196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:14.242780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:14.242780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:14.242780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:14.242780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 311/630] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:14.242780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.279513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.325616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d70bb-a5f6-4f71-9aeb-c56d43c471d2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.346892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d569e9-63ae-4caa-82b8-bf155f8c1fff None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.351199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.361637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.362339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.362617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.362886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.374856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2ba26e2a-1329-4cba-a06f-bf717868414b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:14.379439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:14.380798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 320/631] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:14.382001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.383245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.383245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.388246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.388969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.389155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.389427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.390075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:14.390469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.391832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab02b01-9468-4560-b35a-db88f0949182 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.402701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:14.403897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:14.404450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 312/632] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:14.405647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.405925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.406224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.425335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:14.426586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:14.472327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 321/633] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:14.473171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.491443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 313/634] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:14.496168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.542699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.609080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d84d-e50c-4322-b5d6-557001a10bdb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.627564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.636572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba870621-420b-4e56-a5c9-1ef9cba732f5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.655357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.656765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.657317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.657791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.658674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:14.659171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.660869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.673256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 322/635] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:14.674419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.680616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.681233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.681514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.681785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.682483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:14.682784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.684156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.702167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 314/636] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:14.702167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.799227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23feb2-313f-4733-8d3b-8e40d35f7e91 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.800007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.816925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee6f6b-a6e2-4540-9a4a-83ffb064f15e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.831884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.832505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.832817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.833090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.840498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.841930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.852619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:14.853240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:14.853517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:14.853617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:14.854710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:14.855574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:14.856326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:14.856408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 323/637] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:14.856408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.866658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:14.868815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:14.879981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:14.880915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 315/638] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:14.881833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:14.897897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:14.963371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17edfed-102c-45b0-85fa-68a731f5040c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:14.981650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d929-a545-4b0a-8fd9-2dd451cd63e0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.000863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.001495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.001771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.002041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.013776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.015301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.024084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.024707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.024986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.025252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:15.029681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:15.030660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:15.031530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:15.031530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:15.031530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:15.031530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 324/639] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:15.031756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.035442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:15.040642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:15.041812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 316/640] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:15.042692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.054047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.123406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.135774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ef469-3000-44bf-b3cc-a69624a1fa60 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.149049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961d9d-afef-4e1e-9a30-365a301955ae None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.169760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.170421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.170700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.170979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.183445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:15.186420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.187054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.187331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.187599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.188287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.188587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:15.189600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:15.190508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:15.191412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:15.192312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.192396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 325/641] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:15.192396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.206668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 317/642] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.207541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.270592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.296250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b39e5-0107-48fc-a513-c57dbd3d926c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.307073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf293c5-874c-422f-bfdc-a861d001214e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.329631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.330273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.330550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.330826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.331511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.331818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.333239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.340299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.340534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.340807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.341072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.341710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.342078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.343489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.344934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 326/643] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.345730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.357307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.360287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 318/644] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.361133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.449892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8491aac-0b8d-413e-b041-e16688283b68 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.468951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc622cb-7ff0-49b0-99fd-f3d095b83eff None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.483479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.484104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.484382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.484653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.485311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.485617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.487067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.494493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.495299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 327/645] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.496186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.504371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.505056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.505409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.505769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.506547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.506920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.508331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.516534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 319/646] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.517322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.568537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.604913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b1a08-77d5-4952-ae60-2b0606a69334 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.620903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a447-1af4-4012-8526-6e92fe1487c7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.639838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.640502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.640784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.641058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/486dd7c41a60456892803f8acbb5e36e/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.655620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.655779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=486dd7c41a60456892803f8acbb5e36e, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.656204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.656485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.656756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.657030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.657504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:15.657811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.659262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.665593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 320/647] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:15.666418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.675749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 328/648] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:15 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/486dd7c41a60456892803f8acbb5e36e/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:15.675749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.747364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.816652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22edfe-cdae-4162-a218-1533eb83f5bc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.818653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a8a5-daeb-4fed-a44a-376e85aace2c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:15.855482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:15.870621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.870827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.871841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.871841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.872370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:15.873025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:15.873305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:15.873809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:15.885930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.887597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.889042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:15.891232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:15.900930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:15.902021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 321/649] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:15.903573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:15.911756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:15.912683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:15.913571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:15.913571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:15.913571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:15.916044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 329/650] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:15.916044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.051641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fc74a-ea93-425b-aef8-a18c88f8cd4e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.072797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.075174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e528-8ea4-45db-8366-2b9388624fb0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.107266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.108931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.109420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.109905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.112585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.113327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.113571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.113851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.114675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:16.114986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.116417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.125009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.128007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.140773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 330/651] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:16.141629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:16.147184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:16.148458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:16.149363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:16.149363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:16.149363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:16.149363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 322/652] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:16.149596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.188070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.268977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348e7ec-f8ba-4c73-8e64-523471ac47fb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.282462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e451ab5-cee0-41ad-9c2a-dfd746bdcb2e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.311948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.312542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.312822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.313097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.313861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:16.314154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.315517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.322649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.323556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.324048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.324619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.333002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 331/653] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:16.333914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.359638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.408028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.409949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.448045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.458674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df8d23-cb7f-459a-85c5-58d612df1981 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.494334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.494938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.495237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.495771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.496129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:16.496434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.499464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.518133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 332/654] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:16.518133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.535240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 323/655] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:16.535240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.608473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.649635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0676-45a8-45b3-8646-dae69abbd9dc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.653316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200b78-e740-4119-b61f-e0d82d16af39 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.685749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.686476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.687009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.687138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.692028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.692925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.693407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.693898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.694422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.696428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.703235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.704954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:16.708791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:16.709725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 10:30:16.710704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:16.714471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 333/656] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:16.715352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:16.722162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:16.723109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 10:30:16.724047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:16.734784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.735493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 324/657] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:16.736677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.858285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eead62e-0f3c-4041-b65f-f8a1bcd71d4b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.859458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd512b8c-0299-4ccd-adbb-07f8c555cd26 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:16.884677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:16.896348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.896560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.896772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.897014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.905601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:16.906658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:16.907149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:16.907638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:16.908631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:16.909150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.909392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:16.911021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.911362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:16.928371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:16.929392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:16.930893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:16.930893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:16.930893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:16.930893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 334/658] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:16.931564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:16.935173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 325/659] 10.222.0.52 () {56 vars in 1139 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:16.936254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.048570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dd10e-ec62-4727-bdca-f614ec728ea6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.058885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b7ceb-b7ce-45c1-8417-92f0e1bce9b9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.066398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.087479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.088431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.088920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.089403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.090262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:17.090781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.092340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.095619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.096222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.096500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.096770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.097491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:17.097792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.099382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.105987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 326/660] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:17.107068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.122591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 335/661] 10.222.0.52 () {56 vars in 1137 bytes} [Wed Aug 24 10:30:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:17.122591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.163063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.225482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f782fb4-4c2c-4061-b226-5fbadd287086 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.234281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c7c7b-d0da-4332-ba11-ee72c926f954 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.256177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.265434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.266422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.266980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.267448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.284170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.285589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.286435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.286895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.296548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.298857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:17.314931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:17.315883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:17.316753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:17.319311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 336/662] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:17.321367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.362220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.363831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.421182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.462223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ffbd3-8cc8-4118-b093-ff389770eb5d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.498531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 327/663] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:17.500020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.512152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.513407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.513837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.514580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.594219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.620615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.622376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79787a-4ee9-412a-9d98-d798a3df30ea None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.638836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800f2dd-0a6a-40f6-9cf5-61e36395f7c4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.687604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.689517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.691355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.692982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.694556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:17.697263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.704640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.719021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 328/664] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:17.719937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.734098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.757519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 337/665] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:17.759898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1e1b-a723-4d29-abd4-567fb01cad0f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.760190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1e1b-a723-4d29-abd4-567fb01cad0f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.760473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1e1b-a723-4d29-abd4-567fb01cad0f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.766390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 338/666] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:17.766390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1e1b-a723-4d29-abd4-567fb01cad0f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.855732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda51d-fc5f-406d-803b-bee27bb8c703 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.870551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.890859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.891196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1e1b-a723-4d29-abd4-567fb01cad0f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:17.891808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.892253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.892676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.909755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.911399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:17.927536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:17.928704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:17.929822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:17.929822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:17.929822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:17.929822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 329/667] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:17.929822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:17.935245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:17.936092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.936529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.936966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.937908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=273e5c26e347484d84b6b1b196b11282) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:17.938257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:17.939994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48f47f-fd59-4a1e-80b5-0cbaeff198d2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:17.946763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 339/668] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/role_assignments?user.id=273e5c26e347484d84b6b1b196b11282&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:17.948132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4edb3-b621-42c1-b6a7-6ac4e1f87813 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:17.948551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4edb3-b621-42c1-b6a7-6ac4e1f87813 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:17.948739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4edb3-b621-42c1-b6a7-6ac4e1f87813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:17.995278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:17.996282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c3e4edb3-b621-42c1-b6a7-6ac4e1f87813 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:17.997849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3e4edb3-b621-42c1-b6a7-6ac4e1f87813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:18.072514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7c892-fe69-4016-b0df-69cba02b0836 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.118160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 340/669] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:18.126149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed413-dc7b-4f2b-9697-cae9ca90ea31 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.126149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed413-dc7b-4f2b-9697-cae9ca90ea31 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.126149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed413-dc7b-4f2b-9697-cae9ca90ea31 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.126149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 341/670] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:18.126149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed413-dc7b-4f2b-9697-cae9ca90ea31 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.127191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.131556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.131556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.131556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.150056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:18.151553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-68221c93-7030-4e45-aa07-a383b5d5f140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:18.175949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:18.177141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:18.178861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:18.178861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:18.178861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:18.182212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 330/671] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:18.183589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528380b-977d-4521-bb7b-936de2197eea None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.183906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528380b-977d-4521-bb7b-936de2197eea None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.184157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528380b-977d-4521-bb7b-936de2197eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.243358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4528380b-977d-4521-bb7b-936de2197eea None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:18.246594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4528380b-977d-4521-bb7b-936de2197eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:18.262419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:18.291148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed413-dc7b-4f2b-9697-cae9ca90ea31 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.371309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.377207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.381579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.383614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.386772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:18.389333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:18.400016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:18.400699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 331/672] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:18.401692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528380b-977d-4521-bb7b-936de2197eea None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.440292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:18.441632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 342/673] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:18.447685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.597745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528380b-977d-4521-bb7b-936de2197eea None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.663564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4285e-45ef-43e1-82a6-6cdff5240673 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.675973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.676649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.676869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.677142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.677931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:18.678176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:18.679986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:18.702442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 332/674] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:18.703360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.715004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.715779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.716146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.716643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.718793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:18.731442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:18.737838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:18.738961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:18.739984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:18.741738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 343/675] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:18.743142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.820540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:18.828175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2aa60-4178-4f5c-87fe-9e179d394091 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.869703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.870359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.870722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.871061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.877946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:18.879514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:18.891721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:18.892627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:18.893533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:18.898825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 333/676] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:18.899787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:18.901137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d47c7-63c3-4ff2-b2da-70d537d33ce6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:18.960610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:18.962205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:18.962504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:18.962867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:18.980063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:18.985191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:18.986167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 344/677] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:18.991666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.059077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f622ed-209f-488a-96fc-23d3d8c02c25 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.084962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.109132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.109762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.110040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.110341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.119831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.121561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:19.150149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:19.151122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:19.152022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:19.153758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 334/678] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:19.154482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.175311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14026fe8-a340-489d-8615-1f1156144019 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.185794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.217224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.217872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.218408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.218701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.219829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:19.219829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.221567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.237251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 345/679] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:19.238175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.326267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c6315-8244-4728-bdd6-6630181fa8d9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.375674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.376309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.376658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.376999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.377758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:19.378164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.379727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.397402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 335/680] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:19.399158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.426034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc54a06-dc6c-4d02-a1f0-8284c59f87d8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.450297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.478860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.479813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.480186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.480652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.481420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:19.481814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.483294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.493804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 346/681] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:19.494708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.518857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.548988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de74147-de5f-4554-b782-3fcaa357aeb6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.599739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.600378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.600601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.600869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.602713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:19.603022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.604463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.627870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 336/682] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:19.628760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.661178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91ffe-e49a-45d1-bd5a-4a14e19716f9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.700923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.701555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.701835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.702149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.718800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.720448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:19.742609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:19.743566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:19.744449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:19.744449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:19.744449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:19.744449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 347/683] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:19.745122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.789939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.830051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950670-a912-430c-9da4-2f0c5637f1e7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.882194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.882194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.882194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.882194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.883468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=479086935d3f440599d314c210cdb44a) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:19.883780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.885226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.892984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:19.901172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 337/684] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/role_assignments?user.id=479086935d3f440599d314c210cdb44a&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:19.901995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:19.911020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e3d30-2ba9-4a39-8dec-2ab33d140a54 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:19.955664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:19.956329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:19.956613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:19.956888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:19.969949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:19.971589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:19.989508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:19.990554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:19.996415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:19.996415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:19.996415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:19.996415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 348/685] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:19.996415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.051282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae19531-0e96-4c4b-956e-aa5716d5d2eb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.089874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.100649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.101731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.102313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.103660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.104599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=c648572b085545719bd8b6f1dcdf1a85) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:20.105113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.106775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.118196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 338/686] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/role_assignments?user.id=c648572b085545719bd8b6f1dcdf1a85&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:20.118196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.124141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73be42f-ff89-4388-a66d-fea2ed6435d9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.175750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.176639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.177074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.178061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.179269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:20.180381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.183162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47d43e-1af8-40d1-a201-67595f8dfc7b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.207472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 349/687] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:20.207667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.207750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00325c-c9ac-4d7a-9f9a-cf5b43d037b8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.209782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00325c-c9ac-4d7a-9f9a-cf5b43d037b8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.209782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00325c-c9ac-4d7a-9f9a-cf5b43d037b8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.212567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 350/688] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:20.215058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00325c-c9ac-4d7a-9f9a-cf5b43d037b8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.251058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4e0b-9d13-488c-bfb4-8ee1aa79b5c0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.290061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.290691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.290966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.291228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.291868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:20.292166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.293536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbf382-2780-44ab-942f-b502ae489765 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.308769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 339/689] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:20.310601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.311126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.311545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.349258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:20.350987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:20.372933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00325c-c9ac-4d7a-9f9a-cf5b43d037b8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.427239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.428242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.428526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.428956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.437300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 340/690] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:20.442283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.454889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.456357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:20.494707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:20.495770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:20.497354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 351/691] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:20.505105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.507238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.512718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.558139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b1be-39c3-469b-ad9e-eeb4e15a0898 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.596080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.597104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.597601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.598098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.607007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.608939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:20.622211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:20.623223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:20.624281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:20.627035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 341/692] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:20.635341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.748275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb00e56-75d3-4184-ae76-bd257025c415 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.815849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fde5-147f-4fd0-a1f1-3a2aa3f5663c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:20.821332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.821946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.822251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.822520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.823263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:20.823559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.824989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.833423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.844326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 352/693] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:20.849813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.858175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:20.858908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:20.859289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:20.859701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:20.860658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:20.861066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:20.862736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:20.884861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 342/694] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:20.887238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:20.918788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:20.963876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1acf18-508f-44f9-b5a4-3c1a44ba65a8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.002162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.002162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.002162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.002467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c6e8-5637-4e5c-9da6-19ed50e0b0c7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.002558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.002846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.006085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:21.015839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:21.018243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:21.020295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 353/695] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:21.031632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.056827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.057492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.057769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.062091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.103270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.132744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd2f9-1bee-4d0e-895a-c2d0572d37f8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.136955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.138479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.158704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.172220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.173219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.173679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.174219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.247669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 343/696] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:21.247669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.255285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.257027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.327740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.362501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1eabc7-ce9b-448b-80b6-f5948a05a81a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.375722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 354/697] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 10:30:21.377048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.404277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.439848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.440470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.440742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.441005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.441631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:21.441930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.444925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.456819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 344/698] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:21.457695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.496945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ba1fa-62c6-45c8-880c-e86924317277 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.538285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.539292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.539782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.540291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.556785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.558612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:21.574671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:21.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:21.576530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:21.576530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:21.576530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:21.583304 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 355/699] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:21.584396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.614135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a5d9d-9e1e-4635-958a-c3e3fb8c5d90 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.671678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.684670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.685350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.685615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.685887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.689829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:21.702373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.704636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.719844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c237f-8eaf-4ecc-ad7a-43e83a8318e9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:21.728666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:21.729615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:21.730519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:21.730519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:21.730519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:21.734436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 345/700] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:21.735349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.807769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.808718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.809196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.809778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.810652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:21.811161 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.812728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.826199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 356/701] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:21.827536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:21.866185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7db750-3b6a-4bfd-9b0f-4fa9ef9d07e1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:21.910837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:21.911454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:21.911729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:21.911995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:21.912638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:21.912935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:21.914412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:21.933383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 346/702] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:21.934914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.002093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.064722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc992e6f-c462-4704-923a-0cd6d8b9edf6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.078467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778650-b88b-44f8-99eb-2fa245e85d0a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.107916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.108529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.108808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.109078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.109825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:22.110364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.112055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0c29b-7e24-49ac-88be-bc6eeddd16d3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.122383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.126332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 357/703] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:22.130489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067eab-60e0-45bd-9fc0-f0a422ce93f7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.131007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067eab-60e0-45bd-9fc0-f0a422ce93f7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.131502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067eab-60e0-45bd-9fc0-f0a422ce93f7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.133554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 358/704] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:22.135168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067eab-60e0-45bd-9fc0-f0a422ce93f7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.156360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.157618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.158164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.158816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.168508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.171152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-90cbdd47-85c9-479c-af27-3307035919e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:22.186476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:22.187420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:22.188291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:22.190811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 347/705] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:22.192166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.192599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.192997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.225421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:22.227130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:22.278302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067eab-60e0-45bd-9fc0-f0a422ce93f7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.319393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 348/706] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:22.322577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.323259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.323377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.323643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.323974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.331274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.332857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8a5c8274-a167-43a0-98bc-7431adc75f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:22.345994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:22.347168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:22.348252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:22.349445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 359/707] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:22.350692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a48a-cbe0-4e9b-9335-1d6e55da1b4c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.351043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a48a-cbe0-4e9b-9335-1d6e55da1b4c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.351449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a48a-cbe0-4e9b-9335-1d6e55da1b4c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.356915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 360/708] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:22.357781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286a48a-cbe0-4e9b-9335-1d6e55da1b4c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.379858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.427803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.464359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835ebdf-69f8-4201-80eb-fa9c32d57088 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.472512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286a48a-cbe0-4e9b-9335-1d6e55da1b4c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.502379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.503293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.503759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.504198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.505019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:22.505615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.507470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aec8ef-4667-464c-a79b-5f8f51209f91 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.510717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.511357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.511714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.512035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.512796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:22.513168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.514704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.528388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 349/709] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:22.529900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.530342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.530762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.533650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 361/710] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:22.534652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.552797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:22.554466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:22.626004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 350/711] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:22.626568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.650048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddc808-5154-4a25-9060-22209996ce4a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.668704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.671277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:22.685580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.686321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.686912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.687445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.688294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:22.688705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.690274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.702111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 362/712] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:22.702111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.813897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486c27-73ec-4e26-9eb1-405670556d71 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.898427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.899555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.902087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.902087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.902087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=486dd7c41a60456892803f8acbb5e36e) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:22.902087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.903551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.905103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1eb84-acfe-4d5c-a4ec-ea8ef757a57b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:22.919110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 351/713] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/role_assignments?user.id=486dd7c41a60456892803f8acbb5e36e&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:22.919975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:22.956486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:22.957146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:22.957424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:22.957696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] PATH_INFO: `/v3/services/network` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:22.958338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:22.959780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:22.978100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:22.979222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:22.980080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:22.985176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 363/714] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/services/network => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:22.985176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:23.110091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:23.118753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:23.131667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478dd5c-0d95-4a94-a939-e0365b4f52f7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:23.179023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:23.179862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a53a8-411a-4b92-b575-c64970ddaa3f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:23.186088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.186088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.186088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.199814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:23.201278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:23.218044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:23.219071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:23.220018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:23.220018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:23.220018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:23.220018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 352/715] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:23.225660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:23.231166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:23.231856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.232144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.232417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.233056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] RBAC: Adding query filter params (name=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:23.233358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:23.234774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:23.242361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 364/716] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:23.247859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:23.369193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8750-0ac1-4cbc-9459-2a04fdbdb515 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:23.369660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ddc4-26aa-4dbb-93f6-cb991f60e7d4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:23.384767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:23.411709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:23.412647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.413115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.413564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.413719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:23.414440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.414767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.415227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.415759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] RBAC: Adding query filter params (type=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:23.415981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:23.416290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:23.416778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:23.417669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca3b93-011b-4924-82cd-91e8b404e618 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:23.420405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:23.425892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 365/717] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:23.443319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 353/718] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:23.451438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:23.571880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1028-b8a2-4752-b605-78ada17c0dea None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:23.619409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:23.620927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.621876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.622424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.623287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:23.624921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05405f0-d273-4331-8774-d1900b01c75d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:23.660714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 366/719] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:30:23 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:23.939848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49e6-298b-4bd1-96f1-521e522af576 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.940382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49e6-298b-4bd1-96f1-521e522af576 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.940484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49e6-298b-4bd1-96f1-521e522af576 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.941926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 354/720] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:23.947014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75758b8-9aa7-493f-8fb9-4b36c3c2a4f7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:23.947302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75758b8-9aa7-493f-8fb9-4b36c3c2a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:23.947578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75758b8-9aa7-493f-8fb9-4b36c3c2a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:23.967034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b75758b8-9aa7-493f-8fb9-4b36c3c2a4f7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:23.968215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b75758b8-9aa7-493f-8fb9-4b36c3c2a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:23.995973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:24.050431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 367/721] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:24.347326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec49e6-298b-4bd1-96f1-521e522af576 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:24.359366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:24.505191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec49e6-298b-4bd1-96f1-521e522af576 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:24.556070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:24.557237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:24.557582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:24.557898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:24.558741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:24.560439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6609e4-e12c-4115-8372-eb3d208f89f6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:24.602574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 355/722] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:24 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:25.007100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66317fc-3509-4495-af58-fcf4d77119f1 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.007667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66317fc-3509-4495-af58-fcf4d77119f1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.007667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66317fc-3509-4495-af58-fcf4d77119f1 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.009463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 368/723] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:25.015048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf329-f772-439e-a772-40573f4d3653 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.015452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf329-f772-439e-a772-40573f4d3653 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.015643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bf329-f772-439e-a772-40573f4d3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.042507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-574bf329-f772-439e-a772-40573f4d3653 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:25.043707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-574bf329-f772-439e-a772-40573f4d3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:25.104906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:25.125054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 356/724] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:25.458243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66317fc-3509-4495-af58-fcf4d77119f1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:25.525717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd64f7-6610-4ca2-9ec0-a08ccba79f13 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.526042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd64f7-6610-4ca2-9ec0-a08ccba79f13 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.526279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd64f7-6610-4ca2-9ec0-a08ccba79f13 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.527878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 357/725] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:25.543504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.543782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.544054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.569077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:25.570456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:25.621247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66317fc-3509-4495-af58-fcf4d77119f1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:25.686975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:25.689152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.689430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.689700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.718181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 358/726] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 10:30:25.718352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f33440e0-0395-423b-9f81-4c3f2d568470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:25.719351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:25.720266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:25.721092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 369/727] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:25.727790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:25.751861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ea6d-5764-4c4b-a9d1-3803330342be None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.752162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ea6d-5764-4c4b-a9d1-3803330342be None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.752415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700ea6d-5764-4c4b-a9d1-3803330342be None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.762581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 370/728] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:25 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:25.769102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:25.769381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:25.769654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:25.803359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:25.804582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:25.850571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:25.942101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d378f-fc4c-49ef-9348-9f53ca3821bc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:25.948638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 371/729] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 10:30:25.979668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:25.999162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:25.999887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.000509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.000781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.001045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.001720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:26.002020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.003460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.017982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 359/730] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:26.023862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.127227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641927-acd2-4ebc-9fbc-19572924ab7b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.182091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.182091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.182091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.182091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.200950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:26.209391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:26.210310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:26.211695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:26.217760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 372/731] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:26.218612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.237417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:26.281658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41ca6-2632-4742-833c-2983ef3002b3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.318196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.319217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.319696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.320774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.332916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.334749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.348754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79b3f-2f66-4645-8473-5b6f4c39e191 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:26.350763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:26.351724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:26.352594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:26.352594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:26.352594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:26.354708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 360/732] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:26.355834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.401147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.402786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.403256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.403940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.404837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:26.405290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.406324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:26.410161 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.421415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 373/733] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:26.422528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.504947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c429-510a-48dd-9bb5-766bae023ce1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.525039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:26.546995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.547749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.548064 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.548367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.549037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.550471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.551525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde58a1-7df5-4d78-b78c-0fb76f1adcc7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.565710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 361/734] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:26 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:26.566391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.621478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.622139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.622424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.622698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.623465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:26.623765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.625267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2d47-1158-4ba7-b2ff-b35355ce7d03 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.639563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 374/735] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:26.640988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9e-200c-4012-b4a5-f930b0752543 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.641278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9e-200c-4012-b4a5-f930b0752543 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.641556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbcc9e-200c-4012-b4a5-f930b0752543 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.643196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 375/736] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:26.644744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcc9e-200c-4012-b4a5-f930b0752543 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.755959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:26.770729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1d209-73b7-4271-b0d3-ed6cc72a51c1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.815700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbcc9e-200c-4012-b4a5-f930b0752543 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:26.829930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.831418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.832754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.833650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.850040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:26.854784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.856728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.858103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:26.858969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.859449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.859975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.868733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:26.870534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4b6b3a1c-be3f-45d3-bb76-aa55ff30b367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:26.874377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:26.875316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:26.876186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:26.876186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:26.876186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:26.876186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 362/737] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:26.877373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:26.877711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:26.878091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:26.887184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:26.888225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:26.889147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:26.891737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 376/738] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:26.897096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:26.905762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:26.907018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:26.985948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 363/739] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:26.986923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.013198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b633-b59d-49dc-bdf1-197a165ac024 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.052827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.053872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.054926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.055419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.056265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:27.056764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.058387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.072562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 377/740] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:27.081447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.083991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.117298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81d698-2771-4e3f-955b-fd03ef5f1572 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.205958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.206620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.206895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.207158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.207915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:27.208214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.209704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.218429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.250313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 364/741] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:27.258263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.315351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341b0c-fa3c-4ad2-85a3-9641742c2404 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.365037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.366218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.367307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.367758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.376841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.379344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-006d5993-f0f0-4c9c-9f63-93df4ab9b1f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:27.395558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:27.396556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:27.397467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 378/742] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:27.398913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb21a-a6ec-49e2-8f87-e79cf5be6c76 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.398995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb21a-a6ec-49e2-8f87-e79cf5be6c76 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.399744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddb21a-a6ec-49e2-8f87-e79cf5be6c76 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.400603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 379/743] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:27.401132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddb21a-a6ec-49e2-8f87-e79cf5be6c76 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.412007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d25928-e53e-4020-a324-5b4b2126cd55 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.447233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.447962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.448288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.448556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.450727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.460545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.462536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:27.477073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:27.482918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:27.483879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:27.483879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:27.483879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:27.483879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 365/744] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:27.483879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.519599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddb21a-a6ec-49e2-8f87-e79cf5be6c76 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.531830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.557404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.558168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.558528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.558807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.571341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4482d3cb-58f2-4e58-b6b6-4b07dd4728e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:27.575882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:27.576818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:27.577658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 380/745] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:27.579285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.579285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.579565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.596664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f825cd-f50a-4d34-8b66-4a8f0a482950 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.602839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:27.604114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:27.633542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.634170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.634446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.634714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.635443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:27.635744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.637166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.654921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 366/746] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:27.655786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.687060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 381/747] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:27.688253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.726120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.794168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4268c-c6ea-4f3b-9517-02d701708ffa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.838748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:27.841948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14172-4c66-4a2a-b263-6dc578cfa94f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:27.848418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.849451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.849922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.850232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.850905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:27.851782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.853209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.869785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 367/748] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:27.871296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:27.893997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:27.894809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:27.895187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:27.895920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:27.896402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:27.896823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:27.898938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:27.912560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 382/749] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:27.915075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.006234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa161cc-9e07-4a19-9c42-1813f2e24911 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.010336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.045275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2acbf6-6bf7-4e09-b09b-4d6dbd0b2f10 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.048742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.049351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.049629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.049897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.081218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.081851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.082162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.082435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.089669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.091113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:28.102289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:28.103219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:28.104236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:28.106434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 383/750] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:28.107778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.128978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.130480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.143594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.224092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8633f-7999-425b-8ed7-0188fe0907c9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.249976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 368/751] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:28.249976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.256709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.271567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.272494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.273773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.274050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.285733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.287233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:28.302555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:28.303503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:28.304441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:28.304441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:28.304441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:28.304441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 384/752] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:28.304663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.352565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf200a-5a67-48e3-b551-39aeaa86f8a5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.385440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.393116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.393971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.394435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.394706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.395387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.396639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:28.407955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:28.408940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:28.409772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 369/753] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:28.410603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.417556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1041-f184-4f37-b968-8c48136b425a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.453102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.453710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.453991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.454295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.454989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:28.455301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.456732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.470363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 385/754] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:28.471197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.487099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.524136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64605cbc-97f6-43ea-a0f7-0d8beb851a85 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.560022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.560826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.561171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.561445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.575489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.577661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.581837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872ce8e-95e8-40fc-b3dc-84a2b3b12728 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:28.592311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:28.593422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:28.594484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:28.594484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:28.594484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:28.594484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 370/755] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:28.595027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.625057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.625584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.625859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.626170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.626806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:28.627105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.628453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.629848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.641245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 386/756] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:28.642020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.698022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3e23-6e75-44e2-bbd6-1bd33f10c807 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.716981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.731280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.731989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.732332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.732604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.733220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:28.733520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.734911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.740226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3370-d195-4d33-a153-9b10624ce880 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.740372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 371/757] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:28.741002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.778175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.778827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.779104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.779374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.781251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=f3a5ff3f106248c4ae80b6bc74e0d8f2, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.782699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a26e5-0406-4dcd-8dc1-b6b59f71ca34 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.796340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 387/758] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:28 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:28.797599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c80a-8c80-40d9-8200-f21b920ace56 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.797892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c80a-8c80-40d9-8200-f21b920ace56 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.798192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c80a-8c80-40d9-8200-f21b920ace56 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.799418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 388/759] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:28.805287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c80a-8c80-40d9-8200-f21b920ace56 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.859598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1493b-b49a-40b1-ac9e-5535c39f537c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.903254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:28.904172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:28.904602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:28.905586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:28.906443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:28.907174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:28.908480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:28.908929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:28.928354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 372/760] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:28.929993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:28.966988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8c80a-8c80-40d9-8200-f21b920ace56 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:28.984208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.007744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.008379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.008655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.008925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.017640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.019174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-026047f4-56ba-4e97-944c-e86c3b7cee37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:29.031001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:29.031958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:29.032862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:29.036750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 389/761] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:29.037902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.038304 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.039249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.047183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fdef0-7a5d-47d4-b3d0-679a28c9a67d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.058544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:29.060141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:29.084278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.084996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.085363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.085707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.086456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:29.086827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.088463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.099241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 373/762] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:29.099241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.150160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 390/763] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:29.150160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.200120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.244262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772ac2-a212-42bf-a846-b1cf0b3ab5ac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.267604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5adda-5651-46d0-898a-7385f4a45607 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.271250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.283951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.285136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.285522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.285894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.295700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.297552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.306400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.307193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.307669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.308128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.309003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:29.309483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.311172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:29.311320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:29.312236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:29.313125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:29.318425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 374/764] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:29.321615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.339615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 391/765] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:29.340926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.451767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01faddc-feef-429b-a2f7-5ec54e14a67c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.453564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.457310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739d232-bd39-453d-bfda-88b6a4951d64 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.490623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.491388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.491799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.492075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.492768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:29.493075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.493633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.494338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.494530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.494745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.495077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.496218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] RBAC: Adding query filter params (interface=public, service_id=d6e8bab47c9c4ff98dbc58101fe0dfbc, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:29.496592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.498121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.511026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 375/766] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/endpoints?service_id=d6e8bab47c9c4ff98dbc58101fe0dfbc&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:29.511026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.511273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 392/767] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:29.513258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.550154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.622219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb97f6f-0187-466b-9084-a62b0219b88a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.622829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d601-2bfc-4f87-bcbe-aec24eceedbe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.658013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.658671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.658922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.659193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.662452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.663087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.663369 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.664197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] PATH_INFO: `/v3/services/network` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.664776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.666172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:29.675273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:29.676281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:29.677131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 393/768] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:29.677955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.709752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.735555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.737474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.774754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.786016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419c363-657e-4354-98d5-1b74e96ad86b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:29.821622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:29.822262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:29.822546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:29.822821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:29.823429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:29.824787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:29.829929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 394/769] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:29.830737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.873499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 376/770] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:29.874719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:29.956050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:29.975537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11b891-22de-4a05-bcfa-ddb9761e33e5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.014788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b06b8-01c4-4ae3-81ec-c2dec1cd5657 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.027490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.028114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.028398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.028679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.029409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=486dd7c41a60456892803f8acbb5e36e) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:30.029721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.031849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.039253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 395/771] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/role_assignments?user.id=486dd7c41a60456892803f8acbb5e36e&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:30.040203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.056238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.057141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.057932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.058244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.062324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.073792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] RBAC: Adding query filter params (name=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:30.074025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.075460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.093626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 377/772] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:30.100066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.164871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889ecd5-7bdf-4950-b22f-2ffbe3929ecd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.204547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.205472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.205956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.206402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.219473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.221212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:30.240450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:30.243284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:30.244248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:30.244248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:30.244248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:30.246986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 396/773] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:30.256385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.264774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.361513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead8f6b-40c1-4ece-9a9f-3cc453c34c42 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.380521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1b8c-f2f0-4923-b204-652155dfa25d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.427450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.428084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.429343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.429343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.429715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:30.434089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.434089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.451969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 397/774] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:30.458987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.459701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.460952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.460952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.464233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] RBAC: Adding query filter params (type=network) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:30.464233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.464233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.465293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.472276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 378/775] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:30.477540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.587996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.596898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.666021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976b1cd-ac99-417c-9304-504f46acc363 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.673527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bf758-750b-4d90-9aec-eec13787b00b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.736217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.736864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.737147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.737422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.742832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.743440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.743716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.743983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.744679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] RBAC: Adding query filter params (interface=public, service_id=7a8f6588f2c046eab13726cf7946524b, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:30.744980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.745887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.746410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78881b-10e0-4042-8f3b-43dda2a2b37b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.747359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.751839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 379/776] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/endpoints?service_id=7a8f6588f2c046eab13726cf7946524b&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:30.753290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdf1f-651c-40c0-adcf-0d183711cb66 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.753654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdf1f-651c-40c0-adcf-0d183711cb66 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.754022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdf1f-651c-40c0-adcf-0d183711cb66 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.759985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 380/777] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a94096e2-8235-41ec-b7bb-28dcba744ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:30.760449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:30.761496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:30.762974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 398/778] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:30.764110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdf1f-651c-40c0-adcf-0d183711cb66 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.768994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.769269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.769538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.796964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:30.798442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:30.890827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 399/779] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:30.891954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:30.910766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdf1f-651c-40c0-adcf-0d183711cb66 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:30.953141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.953908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:30.973426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:30.974313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:30.974687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:30.975050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:30.975771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:30.977295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:30.989486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 381/780] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/services => generated 772 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:31.012715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd957-53b6-4a3d-9464-a14bca00fd29 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:31.053383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:31.054940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:31.055432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:31.055879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:31.056778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:31.057274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:31.058922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:31.072652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 400/781] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:31.078997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:31.260487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8cbbd-3c5b-482f-95b4-d9778d92bfd2 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:31.307345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:31.307979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:31.308259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:31.308531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:31.309271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=13727634b06b4eb893941436d7941d18) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:31.309578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:31.311102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:31.317724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 382/782] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:31 2022] GET /identity/v3/role_assignments?user.id=13727634b06b4eb893941436d7941d18&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:31.345752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:31.466698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304f84-39aa-4db6-938e-c0999b9311ce None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:31.484495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:31.511498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:31.512422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:31.512422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:31.512687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:31.531510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:31.536788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:31.537718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:31.538613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 401/783] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:31.544274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:31.626314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:31.681051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f13a9-fa7c-487e-91f4-44ac97bc802e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:31.732186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:31.733090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:31.733518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:31.733937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:31.734792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:31.735299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:31.736854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb0a2c-5640-491b-a748-e9e166cb23e3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:31.751289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 383/784] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:31.756979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:31.977814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61df9a-15dd-40da-9308-72a77b61e0d8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:31.999315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4e05-b824-4cf5-aeae-e6b77c352e14 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:31.999949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4e05-b824-4cf5-aeae-e6b77c352e14 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.000442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4e05-b824-4cf5-aeae-e6b77c352e14 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.002395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 384/785] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:32.007850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039b68-49af-4482-a8ca-346c45a005c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.008132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039b68-49af-4482-a8ca-346c45a005c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.008410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039b68-49af-4482-a8ca-346c45a005c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.027408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.027408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.027672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.027902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.038784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:32.040286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:32.053911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3c039b68-49af-4482-a8ca-346c45a005c6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:32.055478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c039b68-49af-4482-a8ca-346c45a005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:32.065700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:32.066690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:32.067588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:32.067588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:32.067588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:32.072095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 402/786] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:32.078477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.132645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:32.199351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 385/787] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:32.242236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487507-a2bc-4ace-b201-c683a2b33653 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.242745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487507-a2bc-4ace-b201-c683a2b33653 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.243161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83487507-a2bc-4ace-b201-c683a2b33653 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.248769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 386/788] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:32.254222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.254806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.255222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.269113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334129-086d-4af5-b1e7-f8d4589a8132 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:32.290191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:32.293022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:32.337960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.339027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.340448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.340868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.341895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:32.343088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:32.344789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:32.362828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 403/789] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:32.371262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.376352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:32.417770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 387/790] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:32.481153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:32.497611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.506866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92296f-ed9c-40a0-b376-03c58f1bd133 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:32.581776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.582823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.583304 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.583859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.596953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:32.599626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:32.620612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:32.621607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:30:32.622589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:32.632968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 404/791] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:32.636954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.677285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5db39-2cdc-4eec-b791-3365ee58298c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:32.751417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.752050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.752344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.752609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.753187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:32.754657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:32.764095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:32.765082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:32.766342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 388/792] 10.222.0.52 () {56 vars in 1129 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:32.767146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.805492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49bd1-7b65-4016-802e-5823ec868706 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:32.815790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:32.843975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.844712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.845002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.845277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.846259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:32.849202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:32.849202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:32.866975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 405/793] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:32.867882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.876861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:32.898625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25874-ef10-4f6b-9909-a90348915f97 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:32.934323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:32.935287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:32.935763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:32.936275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:32.948142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:32.953787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:32.954740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:32.955630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:32.958312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 389/794] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:32.959400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:32.981960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8eeac-2628-4714-a74d-5b57765a732e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.019296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.019951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.020342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.020625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.021331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:33.021643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.023858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.033521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 406/795] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:33.033521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.076062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.081437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590eab-951c-4433-92db-0e7839cccbec None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.109034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.120088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.121029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.121532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.122018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.145609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ad00-d163-4dc9-a130-a3db7e435825 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.185854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.186446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.186727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.187002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.187669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:33.187976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.189459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.199145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 407/796] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:33.199887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.200725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.202599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.308637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.316338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 390/797] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:33.318172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.323494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2058f-c1a6-4f2a-9a6b-628b1e9e5dd3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.355010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.361513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.362176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.362452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.362783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.363420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:33.363721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.365089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.371599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 408/798] 10.222.0.52 () {56 vars in 1124 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:33.372900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.448641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197d34-67c5-4e84-8ef3-72bfe9355144 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.486058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.486713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.486992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.487262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.487701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8168b8-ccf6-4857-a369-686073411f12 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.501501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.503003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:33.523056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:33.524528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:33.525408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:33.525408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:33.525408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:33.525408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 391/799] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:33.525629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.528455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.529108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.529554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.529669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.541232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.542939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1c4c3e60-c798-4f3c-9f1a-475b081406c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:33.558050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:33.559277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:33.560175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:33.560175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:33.560175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:33.560175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 409/800] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:33.560597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09056-0329-43ee-875e-3f9c39f45c15 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.560874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09056-0329-43ee-875e-3f9c39f45c15 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.561144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09056-0329-43ee-875e-3f9c39f45c15 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.566194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 410/801] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:33.566194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c09056-0329-43ee-875e-3f9c39f45c15 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.587445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.623160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.645761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587115-4faf-4f51-9066-8d4b61446aca None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.675921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c09056-0329-43ee-875e-3f9c39f45c15 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.679915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.680509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.680783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.682341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.683460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.684857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.706053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 392/802] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:30:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:33.706833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.724675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.726115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.726533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.726685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.727370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:33.727681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.729243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa4a84-ff0b-4696-b1f3-5319dfc1ab30 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.747777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 411/803] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:33.747777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c947f-9554-4120-8e93-0e620b2c8092 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.747777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c947f-9554-4120-8e93-0e620b2c8092 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.747777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c947f-9554-4120-8e93-0e620b2c8092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.764387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cc3c947f-9554-4120-8e93-0e620b2c8092 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:33.765617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cc3c947f-9554-4120-8e93-0e620b2c8092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:33.844393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9888-8dfb-4552-b34d-4fc643272da5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:33.852404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:33.871921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 412/804] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:33.876622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d233-16b9-4422-9ab7-15251d417e2c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.876622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d233-16b9-4422-9ab7-15251d417e2c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.876622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d233-16b9-4422-9ab7-15251d417e2c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.878110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 413/805] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:33.878706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d233-16b9-4422-9ab7-15251d417e2c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:33.887911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:33.888596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.888880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.889779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.889779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:33.890128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:33.891534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5bcd-cf8d-4fb7-9f9d-52b14293d6f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:33.910820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 393/806] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:33.911393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:33.911683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:33.911957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:33.947211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:33.950097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:33.952247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.053595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 394/807] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:34.056044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.064655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d233-16b9-4422-9ab7-15251d417e2c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.152342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.153472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.153999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.154558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.169244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.171132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.181760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.191223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38a087-5cd3-4afb-bbb0-a79639fc93e7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:34.196846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:34.197786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 414/808] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:34.203094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.254667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.256127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.256563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.257558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.266992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.268984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:34.295234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:34.296182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:34.297072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:34.305765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 395/809] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:34.306654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.400122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.409612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d250-91d5-47f7-b199-080b0f81eff2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.453149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.453689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.453968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.454271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] PATH_INFO: `/v3/services/network` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.454899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.456223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.463547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ec54-6f25-4d4b-ad4d-66a7433c304b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:34.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:34.470460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:34.471329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 415/810] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:34.472198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.515201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.515822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.516101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.516373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.517109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:34.517416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.519078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.539323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 396/811] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:34.541452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.561986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.613356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65071f-6422-4312-9ac9-58ba34d71294 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.654579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.655201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.655482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.655759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.656980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:34.656980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.658413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.677996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 416/812] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:34.677996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.679854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c05433-bd75-4d72-9ce1-b62420b60015 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.695699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.722909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.724440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.726624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.726915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.745311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:34.750345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:34.751304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:34.752160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 397/813] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:34.753633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.808849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a0611-2eda-414a-b095-0b99b81fe295 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.852218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:34.873206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.873837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.874142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.874420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.875062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] RBAC: Adding query filter params (name=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:34.875366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.876734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.882612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 417/814] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:34.883411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.894775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149e8e6-b7cd-48ff-970b-929144dbfee6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:34.939172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:34.940336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:34.940775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:34.941065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:34.956717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:34.960036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:34.982386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:34.983384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:34.984302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:34.984302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:34.984302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:34.988276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 398/815] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:34.989137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:34.993828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.025940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62619bed-3171-4e64-b2c7-42c0c05f1e9d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.067636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.068731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.069194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.070193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.071207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:35.071820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.073423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.081729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 418/816] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:35.082946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:35.289954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd581ea2-8f9e-488c-8ce1-f3ed7bd757e1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.300454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060d482-073e-476e-a38e-dc5f62acf18c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.341738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.344976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.345551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.345777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.346052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.346775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:35.347073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.348437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.359442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 419/817] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:35.360791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:35.368980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.369646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.369930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.371121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.371809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:35.372116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.375592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.378106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.390571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 399/818] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:35.391334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:35.500124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ea1aa-fd4c-4a13-949a-d0ed57d16bb0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.545456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d808-c312-4773-af4b-73646719bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.545456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d808-c312-4773-af4b-73646719bacb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.545456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d808-c312-4773-af4b-73646719bacb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.545456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d808-c312-4773-af4b-73646719bacb None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.545843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d808-c312-4773-af4b-73646719bacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:35.545843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d808-c312-4773-af4b-73646719bacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.550090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d808-c312-4773-af4b-73646719bacb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.572273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 420/819] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:35.573254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d808-c312-4773-af4b-73646719bacb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:35.578758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c5095-cb24-48e8-b710-777ca1106d71 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.642093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.642093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.642093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.642093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.642504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.646874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.665377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.702293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 400/820] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:30:35 2022] POST /identity/v3/endpoints => generated 337 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:35.702293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:35.724806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d808-c312-4773-af4b-73646719bacb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.801939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:35.902348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c83c-5cd9-44f1-8864-7c7df71779f7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:35.951390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.952877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.952877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.952877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.965249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:35.965249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.965249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.967483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:35.968356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.969695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.975844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:35.978373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4d881f3c-e435-46e9-9f5e-98e44c27826e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:35.992588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:35.993832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:35.995024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:35.995024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:35.995024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-54c54eda-709e-4ae3-8076-29949033d446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:35.995233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:35.996183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:35.997265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:35.998087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 421/821] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:35.998087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d527ce-2484-402c-ac23-9aee643f9bcb None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:35.998315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d527ce-2484-402c-ac23-9aee643f9bcb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:35.998679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d527ce-2484-402c-ac23-9aee643f9bcb None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.000285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 422/822] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:36.000813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 401/823] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:36.005455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d527ce-2484-402c-ac23-9aee643f9bcb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.006329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.006619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.006897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.030185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:36.031673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:36.130165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 402/824] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:36.130165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.153143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:36.180927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d527ce-2484-402c-ac23-9aee643f9bcb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.225600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:36.249601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.250263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.254100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.254100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.254100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:36.254100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.254100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.259181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc99c6-ffb3-4c5b-ba34-3c1c35882d82 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.271100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 423/825] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:36.272433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.333745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.335496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.335496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.335938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.337185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:36.337185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.339415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.358300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 403/826] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:36.364746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.454494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0160998-9d1f-4d5a-93ab-03f7d49334c0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.489544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.490327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.490611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.490940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.500433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.501924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:36.502607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.513032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93e50-fff0-4e42-a099-3863e107af50 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:36.517948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:36.518913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 424/827] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:36.520452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.560532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.561293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.561882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.561992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/486dd7c41a60456892803f8acbb5e36e/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.563983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=486dd7c41a60456892803f8acbb5e36e, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.565401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.577564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:36.590203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 404/828] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:36 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/486dd7c41a60456892803f8acbb5e36e/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:36.591466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.740585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd5d12-faaf-449e-bd72-1512102f23dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.785224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c449-2439-4533-82ee-ea0730dadd41 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.790871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.792644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.793152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.793649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.794488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.796216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:36.809022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:36.810081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:36.810955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:36.811690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 425/829] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:36.817593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.841990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:36.845757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:36.846054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:36.846360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:36.847246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:36.847457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:36.851343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:36.888724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 405/830] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:36.900219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:36.915671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:36.982874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d72dae-9d22-4c82-a434-7067697a1bef None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:36.997943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:37.040340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.040955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.041231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.041497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.042164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:37.043183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5ed67-167f-4db8-8cc7-9ec29996ef1f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.043311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.044634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.053977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 426/831] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:37.059665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.087915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.089060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.089907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.090427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.103463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.105521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:37.126207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:37.127195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:37.128081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:37.128081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:37.128081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:37.136193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 406/832] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:37.137393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.214805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:37.251264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09575fea-b8d8-42d3-9a75-5cdaede8ce7d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.273620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93822058-1b99-43d1-b3a0-669fe8e4f370 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.294523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.295474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.295950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.296434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.297257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:37.297731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.299288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fb7-5b08-4da5-ae56-2384f6a76cf7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.310359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 427/833] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:37.311836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675be9-3616-46aa-94f3-eab17be14b3e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.312126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675be9-3616-46aa-94f3-eab17be14b3e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.312401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675be9-3616-46aa-94f3-eab17be14b3e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.313953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 428/834] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:37.317542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.318385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.318818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.319215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.320080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:37.320513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.322121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.324507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.326188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.326713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.344453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 407/835] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:37.345986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.367813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:37.369038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:37.424078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:37.485139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 429/836] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:37.516771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396140b9-ccbf-4cdc-a0b9-f712f5982838 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.556409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:37.566441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.567100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.567358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.567631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.575034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.576484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:37.590839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:37.591755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:37.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:37.599923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 408/837] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:37.602000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.721716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6fb00-394d-42b9-94ed-d5b9ccac6b42 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.760168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.760781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.761037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.761306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.761992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:37.762320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.763725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.779679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 430/838] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:37.785576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.791006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:37.838869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:37.928924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c542d3-231d-44ad-9daf-406e743642a4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.936411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894199f1-3cf6-47e9-9984-27a17dfb4711 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:37.969596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:37.971610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:37.972089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:37.972206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:37.972733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:37.974145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:37.985574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:37.986761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:37.987656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:37.989532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 431/839] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:37.998843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:38.017224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:38.018298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:38.018815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:38.019338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/13727634b06b4eb893941436d7941d18/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:38.047795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=13727634b06b4eb893941436d7941d18, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:38.049672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:38.077841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 409/840] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:37 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/13727634b06b4eb893941436d7941d18/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:38.121343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:38.147566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcda521-9323-4108-ac0b-714b4563957d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:38.216942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:38.219207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:38.219207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:38.219207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:38.219207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:38.219207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:38.220411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe17a9a-07d0-49c8-96d4-37de7ce951a9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:38.226175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 432/841] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:38.231979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:38.304538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:38.389232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77b658-5df3-409e-ba0b-1288612b06d3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:38.428122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:38.429244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:38.429729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:38.430240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:38.431098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:38.431625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:38.433277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773e787-0f0c-4c7d-b097-9fa68a18f845 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:38.438971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 410/842] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:38.676787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2f7f-e33f-49c2-adcc-be5a33b0576c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:38.677163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2f7f-e33f-49c2-adcc-be5a33b0576c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:38.677359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c2f7f-e33f-49c2-adcc-be5a33b0576c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:38.682885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 433/843] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:38.684765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:38.685048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:38.685318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:38.707269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:38.708447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:38.787915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 411/844] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:39.101287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c2f7f-e33f-49c2-adcc-be5a33b0576c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.214421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c2f7f-e33f-49c2-adcc-be5a33b0576c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:39.249906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:39.250578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.250857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.251130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.262233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:39.267357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:39.268292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:30:39.269129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:39.275608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 434/845] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:39.277780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.310471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:39.387961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf0d5f-8454-4be1-a3e0-ef2dc03c5054 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:39.424697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:39.425305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.425584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.425842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.426539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:39.426841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:39.428197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece429-155d-4355-b869-7ae230c200ba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:39.437689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 412/846] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:39.443337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.462696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:39.468366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03bc6-0998-4fd2-9477-7afcb79c6631 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.468648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03bc6-0998-4fd2-9477-7afcb79c6631 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.468916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c03bc6-0998-4fd2-9477-7afcb79c6631 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.470614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 413/847] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:39.478947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.479294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.479557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.500443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:39.501656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:39.570216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51bef-f9e6-4f63-b919-d0832421b936 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:39.594688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 414/848] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:39.608742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:39.609691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.610325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.610809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.623585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:39.625622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:39.640934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:39.641914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:39.642834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:39.642834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:39.642834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:39.645328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 435/849] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:39.650921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.682460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:39.788943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73003c0-7133-4a12-b1e9-3732edeaa280 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:39.846089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:39.846089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:39.846089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:39.846089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:39.846500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:39.846500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:39.846500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:39.860864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 415/850] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:39.866982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.916412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:39.964372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.016228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c27a-621a-4e75-81f0-dccd3a18cb46 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:40.044235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.067109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:40.067759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.068043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.068322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.079565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:40.082171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:40.087245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd9206-98eb-40fe-a172-ad9240f92203 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:40.098005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:40.099003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:40.099930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 436/851] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:30:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:40.107436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:40.167641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:40.169590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.171129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.171401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.172068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:40.173430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8b0f1-73e9-4dc3-8b64-f53168b9e657 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:40.210096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 416/852] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:39 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:30:40.248919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3edd-c98d-4593-8241-12321690289c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.248919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3edd-c98d-4593-8241-12321690289c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.249211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3edd-c98d-4593-8241-12321690289c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.259709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 417/853] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:40.259709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9dec-0cf5-486e-89ac-c2d26fb685dc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.259709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9dec-0cf5-486e-89ac-c2d26fb685dc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.259709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e9dec-0cf5-486e-89ac-c2d26fb685dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.295330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b6e9dec-0cf5-486e-89ac-c2d26fb685dc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:40.299318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b6e9dec-0cf5-486e-89ac-c2d26fb685dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:40.318918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d3de-12ce-4e04-ac2a-34a06956cb89 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:40.350762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.373324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:40.374287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.374786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.375271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.376239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:40.377018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:40.379710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:40.402106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 437/854] 10.222.0.52 () {56 vars in 1135 bytes} [Wed Aug 24 10:30:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:40.411602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:40.426392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 418/855] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:40.532489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841aa93-0af9-44c1-b9cb-574e5b52e9c7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:40.575617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:40.576480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.576900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.577318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.648254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.654513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:40.656131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:40.696669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797830a-fa13-4b1d-83b3-0e8fa76c9bc0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.696867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797830a-fa13-4b1d-83b3-0e8fa76c9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.698412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797830a-fa13-4b1d-83b3-0e8fa76c9bc0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.698549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 419/856] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:40.705032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.705309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.705575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.727390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:40.729030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:40.777431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 438/857] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:40 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:40.779212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:40.819484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.851104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 420/858] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:40.852523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:40.887961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:40.919913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08d5ce-e7ec-435b-ac89-40487d272665 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:40.968236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:40.969093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:40.969520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:40.969918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:40.995285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:41.000416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:41.001412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:30:41.002249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:41.005470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 439/859] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:41.014247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.050183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037184da-4145-492f-9b57-f4fda89d4362 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.123375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.124248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.125452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.125867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.143051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.144931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:41.164225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:41.165381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:41.166489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:41.166489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:41.166489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:41.168164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 421/860] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:41.170643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.190413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cff7e-7c84-4c3d-8ba5-60c46cdf7cb5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.230994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:41.237393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.238171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.238531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.238874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.239707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:41.240190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.242181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.248840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:41.258006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 440/861] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:41.258006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.300413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd64e1-face-4a19-ac1f-0874a5545686 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.351771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.352381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.352650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.352910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.353570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.354934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.373415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 422/862] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:41 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:41.374963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.409388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f8744-6e72-48a1-87c2-95eef2d57895 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.493063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.493628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.493914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.495134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.497416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:41.497776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.499211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.524265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 441/863] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:41.531437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.598510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0a71f-0c14-4611-b84a-06bb4f19226a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.613932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:41.621642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:41.656405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.657761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.658206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.658615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.673742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.676064 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:41.695663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:41.696640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:41.697507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:41.697507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:41.697507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:41.697692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3759a61-133b-428c-9711-3dcb8fcf175f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.701002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 423/864] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:41.707452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.767815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.769655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.769935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.770227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.783853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.789688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:41.805584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:41.806635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:41.807522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:41.808669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 442/865] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:41.819136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:41.918836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a25c-0372-4a1d-8c32-e1fb5a888bd4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:41.983376 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:41.985845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:41.986139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:41.986408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:41.987054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:41.987353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:41.988806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.021149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 424/866] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:42.022192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcc71-0aec-4a8d-8a78-62a6bb72695a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:42.023596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:42.053363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:42.056321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:42.090660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:42.091646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.092121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.092586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.093487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:42.093987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:42.097660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.123652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 443/867] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:42.128484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:42.213443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dca07-f0ba-43a2-a75a-a82260341fc4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:42.273402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:42.274407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.275716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.276268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.291972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:42.293958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:42.313617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:42.315039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:42.315977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:42.322840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058014-3d28-42b0-8502-2a27659f4e41 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:42.334517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 425/868] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:42.336298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:42.376267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:42.376884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.377162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.377435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.378335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=486dd7c41a60456892803f8acbb5e36e) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:42.378640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:42.380925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537fc01-f630-4687-8eda-5f1a1fbf6fd2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.399053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 444/869] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/role_assignments?user.id=486dd7c41a60456892803f8acbb5e36e&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:42.399053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b9bd-0e78-461d-9e1b-7a9f79e3aaa2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.399053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b9bd-0e78-461d-9e1b-7a9f79e3aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.399053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b9bd-0e78-461d-9e1b-7a9f79e3aaa2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.399053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 445/870] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:42.401229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.401720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.402249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.422022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:42.423638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:42.454772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:42.465559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:42.487201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37113580-189e-4d98-86c6-3a09b2b40ef9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:42.523903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 446/871] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:42.534342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:42.535326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.535928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.536429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.537442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:42.537990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:42.539707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.562434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 426/872] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:42.568707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:42.698803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec89782-158a-4e04-8c5b-5805fbf6363c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:42.734057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:42.734689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:42.734969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:42.735243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:42.777801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:42.807685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:42.809140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:42.855628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:42.921286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 447/873] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:42.932744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.027428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.041357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7224f2-f462-4248-9aac-b64df5002f87 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.063686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998bfef-53d8-4039-b2df-bc7c8aa48b57 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.100030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.102884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.103167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.103438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.104037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.104853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.105392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.105946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.106450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.107338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:43.118967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:43.119991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:43.120840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:43.122481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.124129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.127974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 427/874] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:43.131331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.133923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:43.145692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:43.146678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:43.147945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:43.147945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:43.147945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:43.150562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 448/875] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:43.157713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.340471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249cd3-13c6-4a12-9c6e-2d50b24c38cb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.359135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c316d-a267-4956-97b6-c21de6be78da None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.404391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.413559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.415247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.415524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.415796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.416431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:43.416755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.418137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.431828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.431828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.431828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.431828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.432217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:43.432217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.432560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 428/876] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:43.433536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.434312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f180f-67df-41bc-9309-eadf1c6d21f2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.449785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 449/877] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:43.451731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ecd-75f2-4bec-8bc1-9e779a61773f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.452213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ecd-75f2-4bec-8bc1-9e779a61773f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.452488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ecd-75f2-4bec-8bc1-9e779a61773f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.453819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 450/878] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:43.455842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605ecd-75f2-4bec-8bc1-9e779a61773f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.521698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.571017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63993dc-c4e7-4465-afd5-f0c17faf6f43 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.575258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605ecd-75f2-4bec-8bc1-9e779a61773f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.610915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.611465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.611744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.612013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.612642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:43.613039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.614683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98848ef-5c44-4e6e-8f63-254894a176ea None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.616652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.617948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.618969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.619446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.620799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 429/879] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:43.622298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.622580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.622845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.628695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.630739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.644976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:43.646268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:43.647184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:43.648632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:43.649531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:43.652010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 451/880] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:43.654204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.717228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.750182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 430/881] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:43.750182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.821923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:43.864681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b04a52-7db1-4576-806a-5ecf0d1f6dc9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.896128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0a663-bde3-4ecd-9763-97624a870d6b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:43.936471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.938033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.939170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.939596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.941761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] RBAC: Adding query filter params (interface=public, service_id=82a9c9f292524612a04aee641438c898, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:43.942297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.946263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.955879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 452/882] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/endpoints?service_id=82a9c9f292524612a04aee641438c898&interface=public®ion_id=RegionOne => generated 194 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:43.970091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:43.970279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:43.970279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:43.970279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:43.970279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:43.970641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:43.970641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:43.970641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:43.998100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 431/883] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:43.998100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:44.124369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545854fa-26fd-43f2-bbb0-839ef60baa12 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:44.134976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c685b-6f56-4c19-b487-d8bea56bc258 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:44.144405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:44.148424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:44.170518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861148bb-2928-493f-8256-a9be969f080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:44.171484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861148bb-2928-493f-8256-a9be969f080d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.171972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861148bb-2928-493f-8256-a9be969f080d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.172446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861148bb-2928-493f-8256-a9be969f080d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.173384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861148bb-2928-493f-8256-a9be969f080d None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=13727634b06b4eb893941436d7941d18) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:44.173898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861148bb-2928-493f-8256-a9be969f080d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:44.175604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861148bb-2928-493f-8256-a9be969f080d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:44.181408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:44.182021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.182405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.182678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.183290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:44.194103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:44.194103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 453/884] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/services => generated 1268 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:30:44.194103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:44.195537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 432/885] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:43 2022] GET /identity/v3/role_assignments?user.id=13727634b06b4eb893941436d7941d18&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:44.328950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4f5a0-19c2-48d4-912a-4700db1b1127 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:44.370715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:44.371355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.372038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.372038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.372577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:44.373978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8978877c-a876-4a2f-b9ce-56b636927c57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:44.384856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:44.385886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:44.389321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 454/886] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 24 10:30:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:44.392089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861148bb-2928-493f-8256-a9be969f080d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:44.539218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861148bb-2928-493f-8256-a9be969f080d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:44.550710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100bf88-d9c2-4ee2-9617-1427d74867d7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.551332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100bf88-d9c2-4ee2-9617-1427d74867d7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.551820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100bf88-d9c2-4ee2-9617-1427d74867d7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.554318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 455/887] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:44.559686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.560270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.560764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.579672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:44.580948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.580948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.581142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.581892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:44.582686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:44.586091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:44.589312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 433/888] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:44.596319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:44.604100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:44.605313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:44.661899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:44.690439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:44.751428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 456/889] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:44.768171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e25f-0033-4637-9b7c-334a90423183 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:44.808825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:44.809441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:44.809715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:44.811503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:44.811503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:44.811503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:44.812270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:44.818249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 434/890] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:44.826694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:44.962759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb9ec5-3000-422e-979b-f62349e8953d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:45.003198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:45.003808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:45.004086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:45.004357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:45.006109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] RBAC: Adding query filter params (interface=public, service_id=bb907538721742e5bc51039d23af6e17, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:45.006109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:45.007383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:45.021329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 457/891] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:44 2022] GET /identity/v3/endpoints?service_id=bb907538721742e5bc51039d23af6e17&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:45.026088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:45.068701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:45.159290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:45.218200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e2b0-5ac6-4f0b-a6af-e6ba68fec931 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:45.245638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:45.267601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff66e-63ad-4b69-ad1d-1a6fff641fd3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:45.295324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:45.298089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:45.298089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:45.298089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:45.298089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:45.299087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:45.326291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 435/892] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:45 2022] GET /identity/v3/services => generated 1268 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:30:45.350094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f540e-e769-4777-911e-73469fe3773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:45.350094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f540e-e769-4777-911e-73469fe3773d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:45.350094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f540e-e769-4777-911e-73469fe3773d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:45.350094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f540e-e769-4777-911e-73469fe3773d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:45.351073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f540e-e769-4777-911e-73469fe3773d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:45.351073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f540e-e769-4777-911e-73469fe3773d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-096f540e-e769-4777-911e-73469fe3773d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:45.370213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:45.371703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:45.373602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 458/893] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:45.390093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:45.580384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76ab7-a273-4957-81bb-502940b378b9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:45.617294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:45.619129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:45.619320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:45.622094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:45.622094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:45.622094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:45.622626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d4d9-80e3-4f6c-a57a-21a31adc8590 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:45.628377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 436/894] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:45.633208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f540e-e769-4777-911e-73469fe3773d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:45.737229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:45.748205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f540e-e769-4777-911e-73469fe3773d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:45.804495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:45.805208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:45.805515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:45.805817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:45.806495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:45.806833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:45.808402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a060f8-ef65-45cb-8a88-9611bdd18e64 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:45.818170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 459/895] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:46.606208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475240-b019-49c7-aff2-883074338159 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:46.606753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475240-b019-49c7-aff2-883074338159 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:46.606753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475240-b019-49c7-aff2-883074338159 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:46.608306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 437/896] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:46.613844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:46.614346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:46.614426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:46.633181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:46.634400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:46.639953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ce41-1978-453c-9932-ea748bcc663a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:46.639953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ce41-1978-453c-9932-ea748bcc663a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:46.639953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752ce41-1978-453c-9932-ea748bcc663a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:46.640747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 438/897] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:46.646841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:46.648186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:46.648698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:46.669134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:46.670791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:46.710582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:46.712331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 460/898] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:46.754345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 439/899] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:47.003820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.024711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.127315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:47.133621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec0a0-cd7e-4d5f-a957-af1cd91e9350 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.149289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640aab6-f102-4607-a73f-bdfcc8396aca None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.176811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.177782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.177920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.178231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.179586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.181103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:47.192292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:47.193997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 10:30:47.195170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:47.198360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.199028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 440/900] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:47.199404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.199832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.200250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.200448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.214893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:47.222232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:47.223375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:47.224380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:47.232809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 461/901] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:47.234983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.250540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:47.339301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882a31a-e5af-4389-8f3c-1f968376e9cd None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.382956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.383835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.384111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.384378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.385174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:47.385791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.387468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.389504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff970d0-f0d3-476b-b1ca-43f9fc580e9b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.398655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 441/902] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:47.408713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.454197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.454854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.455138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.455413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.456089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:47.456394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.457772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.467325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 462/903] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:47.473403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.490455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:47.538190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:47.543186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd15ab0-82bc-492f-a6ac-c29c9704ca40 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.599526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.600076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.600394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.600667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.601299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:47.601600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.603057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f552db-8559-4e81-af8d-cdfbe85b2fb8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.610797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 442/904] 10.222.0.52 () {56 vars in 1114 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:47.615731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f46-2bc4-4f04-9c86-2f00704e7dfd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.617090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f46-2bc4-4f04-9c86-2f00704e7dfd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.617721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f46-2bc4-4f04-9c86-2f00704e7dfd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.623349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd190-b5f0-4cf9-8e16-15946af54fd7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.624124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 443/905] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:47.625964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f46-2bc4-4f04-9c86-2f00704e7dfd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.668019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.670107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.670107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.670107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.683152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.684616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6e0948c2-eac3-48e0-99a4-be1dc24b2cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:47.705847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:47.706896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:47.707777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:47.707777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:47.707777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:47.707777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 463/906] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:47.709110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.709403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.709704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.734755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:47.736045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:47.767453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f46-2bc4-4f04-9c86-2f00704e7dfd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:47.808117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:47.815318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:47.816640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:47.817066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:47.817816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:47.818521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:47.820412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:47.823920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 464/907] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:47.825215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:47.858557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 444/908] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:30:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:47.972273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988aa4c-7762-4c40-b564-dadb7876b9fe None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.022107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.023755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.024035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.024349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.025007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:48.025310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.026753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.041349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 465/909] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:48.047252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.070563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.135945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.163798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f76d47-cb53-465c-8f67-db12b5e72b2d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.186550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.208554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.209197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.209469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.209771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.220195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.221675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:48.237355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:48.238432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:48.239373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 445/910] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:48.245081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.255500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777527b0-ed35-49d1-891a-aae0710e2393 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.292531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.293477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.293964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.294444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.295202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.296798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:48.306726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:48.307790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 10:30:48.308665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:48.311201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 466/911] 10.222.0.52 () {56 vars in 1132 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:48.317020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.336660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.362756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027c8f7-679a-42b5-8127-a8f6c198e6c5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.410793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.411699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.412068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.413265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.414302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:48.414612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.416053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2da4d5-c7e3-4f9e-a865-03a6ec1822bf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.432392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6034bf-31cc-4414-8bba-b13e85e889fb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.440472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 446/912] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:48.440738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980a3c-09df-4c93-8cb9-f3ef09e698f8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.441423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980a3c-09df-4c93-8cb9-f3ef09e698f8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.441423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980a3c-09df-4c93-8cb9-f3ef09e698f8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.443695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 447/913] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:48.444895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980a3c-09df-4c93-8cb9-f3ef09e698f8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.447033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.488252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.489076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.489493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.489868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.490848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:48.491867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.493685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28869c-2a0b-4dd0-810a-f0014e2d66d3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.506418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 467/914] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:48.508768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.509447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.509780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.529814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:48.531038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:48.556767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980a3c-09df-4c93-8cb9-f3ef09e698f8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.595968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.596943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.597296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.597644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.602901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.610109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 468/915] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:48.610109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.676591 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.677971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.757622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3890f-d4d2-4d3d-bf10-d62e00e15117 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.761223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.790105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 448/916] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:30:48.796314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.813887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.815037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.815736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.816371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.817307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:48.817847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.820108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.830464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 469/917] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:48.832376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:48.835427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:48.912087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ff95e-6cc1-4cb2-b169-76efdea69e00 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.953083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c956a2-8656-4c80-b872-a31f649ecaac None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:48.955939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.956744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.957078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.957377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.970317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.972455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.989509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:48.990157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:48.990442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:48.990713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:48.991915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:48.992062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:48.993169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:48.994684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:48.994684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:48.994684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:48.994911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:48.997797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 449/918] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:48.998696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:49.026103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 470/919] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:30:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:30:49.026103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:49.049555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:49.138909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:49.150358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f135c-9cf1-4d4c-a872-8b6fb8539aea None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:49.154748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f65bc8-bc1c-4940-8b80-4ea2ba4ef257 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:49.192873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:49.194296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:49.194296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:49.194296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:49.195013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:49.195416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:49.196793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:49.200677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:49.201293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:49.201568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:49.201826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:49.202509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:49.203915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:49.211523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 471/920] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:49.218665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:49.224303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 450/921] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:48 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:30:49.326182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:49.349400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65046642-0d70-4905-b282-bfcab8d685d1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:49.396839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:49.397780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:49.398057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:49.398377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:49.408689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:49.408689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:49.420807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:49.421768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:49.422775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 472/922] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:49.429217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:49.549261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d382c-3d66-422c-bcf5-9e7c983b4406 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:49.593127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:49.593843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:49.594201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:49.594528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:49.595368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:49.595734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:49.597502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea189325-0513-404a-adbd-a528a3695eee None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:49.613597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 451/923] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:49.620070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:49.732683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c72ad9-fd35-4ce5-88d8-e4b5b1825160 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:49.774277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:49.775841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:49.776351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:49.776860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:49.777884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] RBAC: Adding query filter params (role.id=0dd4a66b1073432fb72c5d2325056045, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=13727634b06b4eb893941436d7941d18) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:49.778430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:49.780300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b50558-a331-48b9-a341-9be9bfc875fd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:49.784123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:49.789777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 473/924] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:49 2022] GET /identity/v3/role_assignments?user.id=13727634b06b4eb893941436d7941d18&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=0dd4a66b1073432fb72c5d2325056045 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:50.008666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49635ce-7d3f-4259-812f-309b93121b1f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:50.009212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49635ce-7d3f-4259-812f-309b93121b1f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:50.009321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49635ce-7d3f-4259-812f-309b93121b1f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:50.011155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 452/925] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:50.017887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:50.018253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:50.018585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:50.039786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:50.041158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:50.122905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 474/926] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:50.403012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49635ce-7d3f-4259-812f-309b93121b1f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:50.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:50.530929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49635ce-7d3f-4259-812f-309b93121b1f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:50.573680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:50.574504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:50.574839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:50.575174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:50.575962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:50.577746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:50.580974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING keystone.server.flask.common [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:30:50.605292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.sql.core [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:30:50.605292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:30:50.605292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [parameters: {'id': 'ffd81c512b7e4a0098846e06e49e697e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:30:50.605292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffd81c512b7e4a0098846e06e49e697e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffd81c512b7e4a0098846e06e49e697e. Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:30:50.623041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 10:30:50.625065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application yield resource Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise self.value Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application session.commit() Aug 24 10:30:50.626637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:30:50.627853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:30:50.630274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application result.read() Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:30:50.631195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [parameters: {'id': 'ffd81c512b7e4a0098846e06e49e697e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:50.632861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:50.634200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffd81c512b7e4a0098846e06e49e697e. Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:50.635653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 453/927] 10.222.0.52 () {60 vars in 1140 bytes} [Wed Aug 24 10:30:50 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:50.636431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:50.737356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d02f2c-a384-4774-b545-bcc2b1a4a171 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:50.767022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:50.773807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:50.774631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:50.775376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:50.775376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:50.782337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:50.783779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-14df0605-7f95-4479-9038-ee6d4047a9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:50.795669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:50.798408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:50.801291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 475/928] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:50.807423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:50.884567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:50.932202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cf65e-305b-4c2c-a2a7-5c2f7d42b97f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:50.971041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:50.971652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:50.971928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:50.972198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:50.972881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:50.973249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:50.974846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a8187-649c-486b-bd31-e56e15a87059 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:50.996806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 454/929] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:51.273355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5814b-82d0-48da-af3d-e159a1129b8e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.273757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5814b-82d0-48da-af3d-e159a1129b8e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.274175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5814b-82d0-48da-af3d-e159a1129b8e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.275873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 476/930] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:51.281406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab149c-8602-4ca3-93c4-7c827320c936 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.281872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab149c-8602-4ca3-93c4-7c827320c936 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.282180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab149c-8602-4ca3-93c4-7c827320c936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.301956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-50ab149c-8602-4ca3-93c4-7c827320c936 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:51.304083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-50ab149c-8602-4ca3-93c4-7c827320c936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:51.377239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 455/931] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:51.492527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06dd2f-fe4e-4eeb-9217-22e411137cd6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.492527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06dd2f-fe4e-4eeb-9217-22e411137cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.492527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06dd2f-fe4e-4eeb-9217-22e411137cd6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.492527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 477/932] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:51.501764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c598d-f78d-42e1-8d94-fd2349bf9dde None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.501764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c598d-f78d-42e1-8d94-fd2349bf9dde None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.501764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c598d-f78d-42e1-8d94-fd2349bf9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.518299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3a2c598d-f78d-42e1-8d94-fd2349bf9dde None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:51.519813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3a2c598d-f78d-42e1-8d94-fd2349bf9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:51.577845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:51.597254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 456/933] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:51.654572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06dd2f-fe4e-4eeb-9217-22e411137cd6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:51.764933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06dd2f-fe4e-4eeb-9217-22e411137cd6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:51.801990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:51.802639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.802921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.803199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.803817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:51.805189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:51.814228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:51.815234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:51.816450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 478/934] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:51.817547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029343-2cbc-4956-bcd9-ad727f4fec7c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.817547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029343-2cbc-4956-bcd9-ad727f4fec7c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.817547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029343-2cbc-4956-bcd9-ad727f4fec7c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.818148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 457/935] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:51.821310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:51.822788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.823066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.823356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.844546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:51.846113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:51.886447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:51.920257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 458/936] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:51.920257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:51.933816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97941-bf76-4fa1-b0ea-744882cb1df1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:51.976952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:51.978591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:51.979095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:51.979550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:51.980338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:51.980783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:51.982310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:51.988877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 479/937] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:51.994605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.058051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c1a09-076e-4b6f-9773-c1adcc900213 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.077762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.102027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.102912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.103355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.103765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.104482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.105994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:52.115196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:52.116385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:52.117286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:52.119519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 459/938] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:52.129291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.138306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01f3bc-3984-4766-8de2-2a47b05cfffd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.161654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.185565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.186377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.186741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.187069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.187833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:52.188191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.189911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.196429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 480/939] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:52.229524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.299624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69290a14-c854-4e1e-845c-434658c810f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.359747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.360257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.360775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.361051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.362108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:52.362670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.364092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.364287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970cea9-bb52-4365-800b-e4a41af02efb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.370807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 460/940] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:52.376197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.418325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.419413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.419936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.422415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.426968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.442366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:52.452048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:52.453128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:52.454100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:52.458158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 481/941] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:52.462896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.502938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904beeb2-8669-4118-be0d-a142fce50780 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.532793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.544929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.545530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.545801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.546078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.547152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:52.547152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.548511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.558652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 461/942] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:52.561041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.607852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b76e-6839-4e20-b9b1-57e9f22ea014 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.647896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.648300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.648678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.649045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.649982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:52.650468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.652015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.665566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 482/943] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:52.666632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.695032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7d3e0-7167-44d1-8b2d-4c11a490326d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.705578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.744876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.745665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.746148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.746536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.747334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] RBAC: Adding query filter params (interface=public, service_id=d4336674ce8546088fcb7bc6e77e4801, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:52.747825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.749814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.761341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 462/944] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/endpoints?service_id=d4336674ce8546088fcb7bc6e77e4801&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:52.762400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.794840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27ff3a-3726-4ba1-9b7a-e4e6b45cc545 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.798509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:52.842028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.843538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.844400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.845107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.859232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.860951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:52.879330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:52.880383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:52.881293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:52.881293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:52.881293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:52.886741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 483/945] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:52.888481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:52.901758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b4406-6634-47e2-b86c-fa3fa525f675 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:52.946354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:52.947264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:52.948299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:52.948762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:52.949817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:52.952106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb65c-97e7-4c98-8a8d-38e04eb67911 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:52.961578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 463/946] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:30:53.009048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69c9c2-d9e9-47a2-be5a-c232516d7afb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.030532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de903-f64d-4341-81c3-994cf2526220 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.030882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de903-f64d-4341-81c3-994cf2526220 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.031071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832de903-f64d-4341-81c3-994cf2526220 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.032746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 464/947] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:53.038345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.038672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.038885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.054806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.055803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.056293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.056816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.057690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:53.058038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:53.058452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.059302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:53.060289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.079302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 484/948] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:53.084834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.094807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.111404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.155411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 465/949] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:53.210004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c0a4e-ad14-4b78-be4e-a1ebdc7bbd8f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.245732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.246744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.247259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.247727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.255737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.258105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:53.270247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:53.271201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:53.272148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.275001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 485/950] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:53.283406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.401294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbcfcb-31f5-4e6b-aa32-5206feea14fd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.439777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.440308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.440674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.441018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.441925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:53.442331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.444348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.457695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.466286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 466/951] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:53.475425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.504554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.559373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.584560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b399f28-5427-4526-acd3-5a4929ff0bdb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.590516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacc2fa-2179-4d8e-a222-40837c9822ac None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.621950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.622596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.623033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.623308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.624062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.625586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.628168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING keystone.server.flask.common [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 10:30:53.629707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.630601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.631095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.631612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.641276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.sql.core [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:30:53.641276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:30:53.641276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [parameters: {'user_id': 'ba564177a8e24192aa31913200cdff8b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:30:53.641276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81677) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 10:30:53.643719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.645415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 24 10:30:53.649067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:30:53.649939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application yield resource Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise self.value Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application session.commit() Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 10:30:53.651195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.flush() Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application compat.raise_( Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 10:30:53.652063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 10:30:53.653099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 10:30:53.653936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ba564177a8e24192aa31913200cdff8b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:53.654820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 10:30:53.655663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.656597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 486/952] 10.222.0.52 () {60 vars in 1131 bytes} [Wed Aug 24 10:30:53 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:53.661901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:53.671849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:53.672885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:53.674012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:53.674012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:53.674012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:53.675797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 467/953] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:53.682324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.781273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d382b9-bc44-4e20-95d1-f362b8f234d7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.785315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.814933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa6e5-18f2-45bc-b2c6-0630762c3343 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:53.830525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.831708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.832163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.832625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.847552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.851321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.854269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:53.859021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:53.859786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:53.860201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:53.860566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:53.861361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:53.861800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:53.863857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:53.869138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:53.870108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 10:30:53.871056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:53.874192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 487/954] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:53.881180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:53.884242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 468/955] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:53.889788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:54.014506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb374-cb94-41c4-b5dc-d75a965e2c5a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:54.019812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de182a-0ee7-4f69-972d-5e276f9f32b4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:54.061423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:54.062445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.062947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.063417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.063700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:54.064340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.064621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.064893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.065174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:54.065679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:54.067155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:54.068796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299065-bbe5-4bf9-ba7f-772b25ce95f7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:54.073136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:54.074765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:54.087941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:54.088894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:54.089794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 469/956] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:54.095010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:54.124018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 488/957] 10.222.0.52 () {56 vars in 1101 bytes} [Wed Aug 24 10:30:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:54.220858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb18f4b-f870-407c-be15-960b3b17a73b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:54.231345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423c44-a6ca-41db-923f-812d720cee26 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.231971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423c44-a6ca-41db-923f-812d720cee26 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.232448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423c44-a6ca-41db-923f-812d720cee26 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.238752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 489/958] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:54.240540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.241636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.242137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.262636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:54.263258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.263539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.263766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:54.263887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.264494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:54.264800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:54.266046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:54.266259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:54.280879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 470/959] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:54.287067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:54.336753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:54.364572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 490/960] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:54.375709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:54.425987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e12361-cc15-4f56-bc2d-beb5d47a2c3f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:54.463031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:54.463713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.463986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.464271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/13727634b06b4eb893941436d7941d18/roles/0dd4a66b1073432fb72c5d2325056045` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.466500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=13727634b06b4eb893941436d7941d18, role_id=0dd4a66b1073432fb72c5d2325056045)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:54.467902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd26d39-2d73-433d-9438-0e9d08d7256e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:54.483838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 471/961] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:30:54 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/13727634b06b4eb893941436d7941d18/roles/0dd4a66b1073432fb72c5d2325056045 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:30:54.649665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:54.754758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887d0f2-9030-4dd2-b95d-842b6dbcb240 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:54.790692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:54.791339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:54.791623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:54.791896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:54.792566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:54.793942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d95f8-d7ad-475b-be95-8d8e8fcdd6b9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:54.818139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 491/962] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:30:54 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:30:55.149143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a95e6-a40a-41ad-a910-38e911d07524 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:55.149513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a95e6-a40a-41ad-a910-38e911d07524 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:55.149878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a95e6-a40a-41ad-a910-38e911d07524 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:55.151614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 472/963] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:55.156912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:55.157352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:55.157640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:55.176343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:55.177523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:55.228831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:55.266438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 492/964] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:55.560301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a95e6-a40a-41ad-a910-38e911d07524 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:55.676354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a95e6-a40a-41ad-a910-38e911d07524 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:55.692769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:55.718026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:55.718697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:55.719047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:55.719390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:55.720157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:55.721750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:55.731360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:55.733305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:55.735727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:55.743647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 473/965] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:55.743874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:55.868100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90edba-1694-4509-a00e-0309349f19e3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:55.904317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:55.904933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:55.905213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:55.905484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:55.906149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:55.906454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:55.907820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:55.918446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 493/966] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:55.919821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:56.030154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07314787-8ec4-4d75-a622-89558bbb2d7f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:56.064875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:56.065480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.065757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.066022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.066685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:56.066986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:56.068353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20356858-510e-41a0-a363-752c2515cdfe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:56.078099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 474/967] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:56.079213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:56.115356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:56.184067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffa6b7-62a9-4ac8-bc7f-0b8abaeca107 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:56.219457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:56.220077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.220358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.220629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.221331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:56.222692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc9c8a-6299-49e6-bf68-a9b074997db7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:56.250101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 494/968] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:30:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:30:56.443603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33db-29bc-4d37-9ab3-5f1b9a7faf5a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.443990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33db-29bc-4d37-9ab3-5f1b9a7faf5a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.444186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33db-29bc-4d37-9ab3-5f1b9a7faf5a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.445838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 475/969] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:56.451344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb722c-5767-4abd-a4e2-aa24711290b0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.451633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb722c-5767-4abd-a4e2-aa24711290b0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.451914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb722c-5767-4abd-a4e2-aa24711290b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.471164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-08eb722c-5767-4abd-a4e2-aa24711290b0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:56.472355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-08eb722c-5767-4abd-a4e2-aa24711290b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:56.547955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 495/970] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:56.773650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e8841-d544-4578-aa1a-cbb69cd69761 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.774311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e8841-d544-4578-aa1a-cbb69cd69761 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.774311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e8841-d544-4578-aa1a-cbb69cd69761 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.775638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 476/971] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:30:56.780837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.781129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.781413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:56.799444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:56.800637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:56.814584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:56.818173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e8841-d544-4578-aa1a-cbb69cd69761 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:56.875963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 496/972] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:30:56.889002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:56.956960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e8841-d544-4578-aa1a-cbb69cd69761 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:56.991426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:56.992039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:56.992309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:56.992562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.003588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:30:57.008850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:57.009851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:57.014770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 477/973] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:30:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:57.016941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.132308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c3f5e-d037-4ed2-987d-fb630ec5988c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.147817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.172268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.172891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.173179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.173452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.174223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.174528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.175904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.185501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 497/974] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:57.191286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.207730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.276331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c51d7f-7043-49d9-bca5-0d45c5c930d5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.278427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.321172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a13786-7092-4619-bed6-e8ec09e05297 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.324348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.324539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.324855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.325173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.325876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.327633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:57.338871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:57.339882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:57.340715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 478/975] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:57.346212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.368348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.369177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.369534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.369850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.384381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.385876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:57.402362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:57.403364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:57.404309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:57.404309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:57.404309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:57.404309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 498/976] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:57.410436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.471604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b3b-4002-47b8-8548-1f0c87fcdddb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.485854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.514851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.515549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.515922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.516227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.516895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.517227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.519113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.525494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 479/977] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:57.527685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c66a-4eec-42e7-b20f-70a47e28f80e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.531964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.566352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.569508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.570303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.570709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.571267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.572095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.572522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.574322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.591902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 499/978] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:57.597806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.651101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e296-fc99-4822-a6ef-e94decef2c24 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.690407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.691148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.691426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.691692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.692317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.692614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.694002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.703841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 480/979] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:57.704894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.736960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e3fff-3907-420d-bcc8-3f042b7555e3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.764606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.779070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.779704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.779983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.780256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.788348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.789819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:30:57.801929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:57.803322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 10:30:57.805133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:57.808125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 500/980] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:30:57.808987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.810534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:57.819600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1f30-c0fa-4b4e-9829-d8d488ad7897 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.861440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.862060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.862371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.862646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.863354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] RBAC: Adding query filter params (interface=public, service_id=73963115dd43402b9b1271c6394ff3aa, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.863687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.865054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.870439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 481/981] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/endpoints?service_id=73963115dd43402b9b1271c6394ff3aa&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:57.876344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:57.932886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5127e9-778e-4def-989d-2e8809ab751f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:57.968213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:57.968835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:57.969122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:57.969396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:57.970168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:57.970482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:57.971990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:57.990589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 501/982] 10.222.0.52 () {56 vars in 1149 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:57.996122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.002316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9375-34e0-4594-b023-72527f4e2b85 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.041835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.044559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.045292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.045569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.045891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.046479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.047847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d2f39-a5c7-4f1d-bf7e-edf1dcf74b01 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.055430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 482/983] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:30:58.115275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275037-ead1-43ed-a335-ffcefa9f197c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.156793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.157719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.158223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.158650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.239271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf78d-1e0d-458b-8f11-b0c92fa6ab43 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.239465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf78d-1e0d-458b-8f11-b0c92fa6ab43 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.239732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf78d-1e0d-458b-8f11-b0c92fa6ab43 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.241129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 483/984] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:30:58.245475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.247232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.247480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.247784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.248084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.266927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:30:58.268128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:30:58.288618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.291330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.350419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 484/985] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:30:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:30:58.361156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 502/986] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:30:57 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:30:58.362517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.468338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88861287-4956-4914-a8a1-79c9d7552ae3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.504234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.504758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.505040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.505309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.515695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.517186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:30:58.532775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:58.533899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:30:58.537534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:30:58.537534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:30:58.537534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:58.538556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 485/987] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:58.540167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.631762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.635849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.649482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b8a85-5535-4680-bce1-f44788c5b63d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.687052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.687707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.687942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.688212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.688854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:58.689359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.690564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.699193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.704457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 503/988] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:58.710560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.756024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd4fb1-48c1-43dc-a537-ba66b465f364 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.792524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.793156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.793441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.793711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.794316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.795697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:58.804350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:58.805504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:30:58.806509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 486/989] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:58.811547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.831357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4ac7-4b2d-4b4a-8034-09703b82c12a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.877455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.878248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.878535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.878901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.887394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.888517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.890408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:30:58.905364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:30:58.906355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:30:58.907383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 504/990] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:30:58.914045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:58.927232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d4072-078d-4826-b580-ed59c9c9828b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:58.965363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:58.966356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:58.966782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:58.967223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:58.968008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:58.968461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:58.970109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:58.975338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:58.976444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 487/991] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:58.981952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:59.019160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f6f00-690c-4b09-bea4-565d1bcd4f91 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:59.057688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:59.058347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:59.058619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:59.058895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:59.059591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:59.059900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:59.061335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:59.075110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 505/992] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:59.081221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:59.098396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae494bb8-bb08-498e-910a-31a58661c3ae None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:59.135367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:59.141692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:59.142395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:59.142644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:59.142911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:59.143556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:59.143854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:59.145231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:59.151773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 488/993] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:30:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:59.158860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:59.201326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43865c40-3cce-41d1-9a64-b5cae1bec0b6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:59.223082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:30:59.238506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:59.239116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:59.239400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:59.239680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:59.240409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] RBAC: Adding query filter params (role.id=0dd4a66b1073432fb72c5d2325056045, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=13727634b06b4eb893941436d7941d18) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:59.241259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:59.243262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:59.249825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 506/994] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:30:59 2022] GET /identity/v3/role_assignments?user.id=13727634b06b4eb893941436d7941d18&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=0dd4a66b1073432fb72c5d2325056045 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:30:59.276383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043015e-de69-421b-aea8-3a2da9dfc341 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:59.316704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:59.317676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:59.318285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:59.319303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:59.320226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] RBAC: Adding query filter params (interface=admin, service_id=d4336674ce8546088fcb7bc6e77e4801, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:30:59.320720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:59.322469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237e873-9cef-44e0-ba0d-596d18b7cd11 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:59.333747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 489/995] 10.222.0.52 () {56 vars in 1249 bytes} [Wed Aug 24 10:30:59 2022] GET /identity/v3/endpoints?service_id=d4336674ce8546088fcb7bc6e77e4801&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:30:59.335154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:30:59.457528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91746076-b80f-45c7-959d-78f5e5d26da3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:30:59.493399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:30:59.494300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:30:59.494827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:30:59.495266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:30:59.496021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:30:59.497530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324885f-adc1-412b-aa29-5b06f06d09ec None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:30:59.504308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 507/996] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:30:59 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:31:00.073265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2860c-b20a-4953-95ca-ff7f2aa8231d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:00.073827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2860c-b20a-4953-95ca-ff7f2aa8231d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:00.073827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2860c-b20a-4953-95ca-ff7f2aa8231d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:00.075309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 490/997] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:00.080327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:00.080617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:00.080891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:00.099753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:00.102455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:00.150896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:00.177266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 508/998] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:00.462862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2860c-b20a-4953-95ca-ff7f2aa8231d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:00.528539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:00.573178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2860c-b20a-4953-95ca-ff7f2aa8231d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:00.610256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:00.610892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:00.611167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:00.611434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:00.612008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:00.613377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:00.622362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:00.623530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 10:31:00.624615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:00.628583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 491/999] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:31:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:00.629599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:00.729983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46dc0-c48e-454f-a0c0-884b71883732 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:00.763862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:00.764479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:00.764759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:00.765032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:00.765664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:00.765970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:00.767371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:00.775438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 509/1000] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:31:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:00.782163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:00.893086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19da4c-aa61-49cc-a0fd-45fae4379cc1 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:00.919181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:00.930719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:00.931327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:00.931600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:00.931870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:00.932494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:00.932792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:00.934178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557164-1c22-408d-b62b-eac1a4f4c370 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:00.939486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 492/1001] 10.222.0.52 () {56 vars in 1112 bytes} [Wed Aug 24 10:31:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:00.944937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:00.991228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:01.051555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f281492-3a0c-49da-b642-3fc271565efd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:01.088576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:01.089185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.089463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.089733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.090445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:01.091800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a31ab-baa5-44b2-8934-cc76c010a71f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:01.113603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 510/1002] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:31:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:31:01.275424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c09ca-3bed-459a-8b4f-cf63f7df36a2 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.275915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c09ca-3bed-459a-8b4f-cf63f7df36a2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.276035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c09ca-3bed-459a-8b4f-cf63f7df36a2 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.277967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 493/1003] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:01.283379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656045-38fd-4d24-a3ba-74b5c982bca7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.283702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656045-38fd-4d24-a3ba-74b5c982bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.283980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d656045-38fd-4d24-a3ba-74b5c982bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.303711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4d656045-38fd-4d24-a3ba-74b5c982bca7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:01.305085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4d656045-38fd-4d24-a3ba-74b5c982bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:01.387001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 511/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:01 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:01.423377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4143-f811-499e-98a5-9d55206730ee None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.423796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4143-f811-499e-98a5-9d55206730ee None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.423973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4143-f811-499e-98a5-9d55206730ee None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.425451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 494/1005] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:01.431626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.431956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.432296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.452917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:01.454116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:01.473630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:01.528609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 512/1006] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:01 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:01.664300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4143-f811-499e-98a5-9d55206730ee None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:01.770027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4143-f811-499e-98a5-9d55206730ee None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:01.800553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:01.808910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:01.809837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.809837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.810124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] PATH_INFO: `/v3/services/image` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.810685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:01.812065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:01.824068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:01.825059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:01.827215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 495/1007] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 24 10:31:01 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:01.830951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:01.893064 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:01.924272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b22f-1969-4326-9c36-c086ead7c67d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:01.945855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c407-1939-4e0f-9662-e0b385115339 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:01.962755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:01.963482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.963791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.964103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.964756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:01.966380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:01.976947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:01.978016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:01.979043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 513/1008] 10.222.0.52 () {56 vars in 1126 bytes} [Wed Aug 24 10:31:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:01.983628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:01.984176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:01.984532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:01.984722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:01.985003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:01.985632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] RBAC: Adding query filter params (name=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:01.985935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:01.987396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:01.998607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 496/1009] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:01.999564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:02.010879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:02.104428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d2956-4945-4c87-ab5e-d9bfb216ea9d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:02.114000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4b05-1b48-425c-9918-06ae82695919 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:02.132624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:02.147877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:02.148494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:02.148791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:02.149066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:02.149717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:02.150021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:02.151508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:02.154718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:02.155491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:02.155914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:02.156330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:02.156472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 514/1010] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:31:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:02.157240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:02.157548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:02.158933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:02.162055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:02.174650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 497/1011] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:02.261962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:02.287102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aa63f-1d98-401f-a7d6-2b580e705194 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:02.328525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:02.329244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:02.329564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:02.329928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:02.330719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:02.331079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:02.332631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e0d0d-1724-4c36-bef0-acdc4b51e3ae None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:02.339530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 515/1012] 10.222.0.52 () {56 vars in 1122 bytes} [Wed Aug 24 10:31:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:02.345862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:02.454582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d398-342d-4228-bd17-1d7eea2e1520 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:02.490028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:02.490683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:02.490958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:02.491222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:02.491883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:02.493241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37618c98-30b9-4375-83cd-6e0e72109377 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:02.518109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 498/1013] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:31:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:03.202497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe0e0-6539-4ee5-ae7b-d0da79ba84a8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:03.203048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe0e0-6539-4ee5-ae7b-d0da79ba84a8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:03.203129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fe0e0-6539-4ee5-ae7b-d0da79ba84a8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:03.204724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 516/1014] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:03.210596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:03.210884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:03.211155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:03.229286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:03.230536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:03.270962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:03.317565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 499/1015] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:03 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:03.591991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe0e0-6539-4ee5-ae7b-d0da79ba84a8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:03.711368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fe0e0-6539-4ee5-ae7b-d0da79ba84a8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:03.748195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:03.748881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:03.749547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:03.749998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:03.761291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:03.767207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:03.768197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:03.769217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:03.774175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 517/1016] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:31:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:03.775014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:03.895157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab5bc2-468f-44b7-b34f-2c2d1d23d4f4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:03.932040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:03.932650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:03.932926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:03.933203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:03.933854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:03.934180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:03.935621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc31d9-4202-4e27-96b3-c945a6bdcbd7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:03.944706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 500/1017] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:31:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:03.950181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:03.960572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.060497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd3bb2-62a0-44ff-9e29-660c031d8ee0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.089693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038024-3ec1-49d9-9858-8e729fe50f26 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.090016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038024-3ec1-49d9-9858-8e729fe50f26 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.090485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1038024-3ec1-49d9-9858-8e729fe50f26 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.092901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 501/1018] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:04.098143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.098463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.098693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.101393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.102037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.102350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.102879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.116580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.117900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:04.118109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.119143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:04.133472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:04.134683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:04.135673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:04.135673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:04.135673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:04.135673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 518/1019] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:04.140884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.149400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.195934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 502/1020] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:04 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:04.204801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.248612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2c0f1-9c07-4dfa-809c-4313efeb705f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.283990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.284603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.284885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.285159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.285810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:04.286139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.287541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bc144-6fb5-4c8f-813f-854036327a10 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.304444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 519/1021] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:04.305662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.411385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118013d-03ea-465a-bce4-1e41e63a38b3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.429184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f03dc-edc6-4f98-977a-1c02b18409ca None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.429502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f03dc-edc6-4f98-977a-1c02b18409ca None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.429739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f03dc-edc6-4f98-977a-1c02b18409ca None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.431271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 520/1022] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:04.436270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.436611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.436847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.448920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.449557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.449838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.450134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.456031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:04.457232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:04.457439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.458884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:31:04.472607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:04.473688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 503/1023] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:31:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:04.474743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.499093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.531024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 521/1024] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:04 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:04.531888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.585548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.589975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556338-0402-4740-af35-a08dc5a4daf8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.627046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.627653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.627931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.628204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.628848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.630246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.643702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18b6bd-83f1-42cc-943e-5847ad4ffb07 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.645888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 504/1025] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:31:04 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:04.694577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.695666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.696190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.696698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.697700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:04.698303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.700003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.722025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 522/1026] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:31:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:04.728007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.817215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.820550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:04.847343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d4b5-7b00-4d6e-97c7-14fefa433133 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.886241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.887273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.887554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.887827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.952785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7083488-3339-4601-8ae9-50be32d6bafe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:04.954864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:04.961409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.963205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:04.993286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:04.994039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:04.994347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:04.994620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:04.995738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:04.997413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.002244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 523/1027] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:05.004878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.051129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.075998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 505/1028] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:05.083225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.119944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67fa05-3e94-40c0-ab75-2aaf77b029cc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.157652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.158743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.159227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.159803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.160521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.161940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.194100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 524/1029] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:31:05 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:31:05.203655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94594ba-d33a-4700-87e5-cd7bf5aeb696 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.243328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.243986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.244261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.244530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.257061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.258586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:05.275905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:05.283344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:05.284244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:05.284244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:05.284244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:05.284244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 506/1030] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:05.284486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.314176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.401527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc03c0-5b3f-4463-a7a1-c358221add30 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.442884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.444289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.444628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.445005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.445758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:05.446201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.447689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.466220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 525/1031] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:05.467902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.502502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.582698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a1b2f-b3e8-4141-9f0b-81de8ca992df None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.624034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caff65-5be1-4021-833d-77879976074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.624694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caff65-5be1-4021-833d-77879976074f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.625014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caff65-5be1-4021-833d-77879976074f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.625284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caff65-5be1-4021-833d-77879976074f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.632495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caff65-5be1-4021-833d-77879976074f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.633946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9caff65-5be1-4021-833d-77879976074f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b9caff65-5be1-4021-833d-77879976074f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:31:05.647797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:05.648929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:05.650054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 507/1032] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:31:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:05.654753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.747886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.769313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986c16d-888e-42ac-aef3-f0e12b0c9539 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.808113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.808948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.809330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.809671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.810463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:05.810839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.812318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d643-cc1d-4b9b-9789-29f7832fe007 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.830951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 526/1033] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:05.832486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caff65-5be1-4021-833d-77879976074f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:05.933700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:05.945390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caff65-5be1-4021-833d-77879976074f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:05.979738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:05.980424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:05.980765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:05.981099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:05.981881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] RBAC: Adding query filter params (role.id=0dd4a66b1073432fb72c5d2325056045, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:05.982281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:05.983754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396155-cc8e-4d5f-95b2-061a406b5b10 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:05.995443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 508/1034] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:05 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=0dd4a66b1073432fb72c5d2325056045 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:06.606431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48f943-5103-41d6-a915-b0c06f4cd83d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:06.606961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48f943-5103-41d6-a915-b0c06f4cd83d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:06.606961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48f943-5103-41d6-a915-b0c06f4cd83d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:06.608593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 527/1035] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:06.614082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:06.614443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:06.614653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:06.634185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:06.635388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:06.706233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 509/1036] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:06.972066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48f943-5103-41d6-a915-b0c06f4cd83d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.086775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48f943-5103-41d6-a915-b0c06f4cd83d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.121371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.122008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.122323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.122602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] PATH_INFO: `/v3/services/image` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.123187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.124552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3586c832-3d9c-4546-a631-dbd97aa03c6f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:07.133919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:07.135025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:07.135977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:07.138400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 528/1037] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 24 10:31:06 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:07.140922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.152335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b302ec-ee5a-4031-aea5-7dd6ba2cc9f5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.152634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b302ec-ee5a-4031-aea5-7dd6ba2cc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.152922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b302ec-ee5a-4031-aea5-7dd6ba2cc9f5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.154613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 529/1038] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:07.160130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.160419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.160849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.173696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:07.180013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:07.181238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:07.242631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:07.261002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 530/1039] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:07.262279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c955feb-b2b0-402f-b905-1d4e65f13c4f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.298206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.298813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.299088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.299355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.299975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] RBAC: Adding query filter params (name=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:07.300277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.301641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.307008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 510/1040] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:07.312562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.415099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3014f-286a-4a87-b0e1-2d220f71f2d3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.452867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.453479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.453810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.454136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.454883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] RBAC: Adding query filter params (type=image) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:07.455243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.456786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.458980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:07.465399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 531/1041] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:07.471205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.556966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.582132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d5eef-baab-4f58-9e21-24bfd277ac3e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.623388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.623997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.624271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.624594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.625235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] RBAC: Adding query filter params (interface=public, service_id=b4ae4bd71c6342a6b752b6b5a1bfe039, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:07.625675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.626946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.632213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 511/1042] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:31:07 2022] GET /identity/v3/endpoints?service_id=b4ae4bd71c6342a6b752b6b5a1bfe039&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:07.638219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.653408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:07.684097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b40b4-1111-4b26-bbb4-a467ab36f777 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.722491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.723260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.723612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.723928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.725842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.727622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.729597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 532/1043] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:07.736254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:07.752219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c553c3-fb0c-42f9-b192-b18cab7e771f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.794151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.794704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.794980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.795246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.795856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.797227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8122b-35bb-4a15-a866-2e290b76a634 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.804606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 512/1044] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:31:07 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:31:07.824635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:07.875126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d8788-f438-450d-a2b2-bddf0a18e234 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:07.923014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:07.923759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.924111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.924427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.925298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:07.927288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:07.933078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1dc23-f4c0-48e7-95c5-d8fb62e8f99c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.933374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1dc23-f4c0-48e7-95c5-d8fb62e8f99c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.933617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1dc23-f4c0-48e7-95c5-d8fb62e8f99c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.935175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 513/1045] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:07.941016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:07.941297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:07.941568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:07.954560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 533/1046] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:31:07 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:07.964906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:07.966382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:08.054113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 514/1047] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:08.319451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:08.428923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7582f-79dd-474e-a3a0-99a4e4d57eaf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:08.456292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:08.472766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:08.473606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:08.473996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:08.474407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:08.485390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:08.490059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:08.491532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:08.492396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:08.494404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 534/1048] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:31:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:31:08.497608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:08.506506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:08.601177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132dbe8-62e5-4de4-b234-a635709a46ef None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:08.637613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:08.638300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:08.638661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:08.638930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:08.639725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:08.640027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:08.641582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:08.651973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 515/1049] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:31:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:08.658306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:08.764173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bf015-3e56-42f4-864f-9b6494d7eabb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:08.798253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:08.798877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:08.799156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:08.799426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:08.810377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:08.811819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:08.825829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:08.826964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:08.828049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:08.828049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:08.828049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:08.830409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 535/1050] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:08.833687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:08.907873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:08.945145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096d51f-bd5c-4b9f-a428-c20f80630830 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:08.982164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:08.982800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:08.983080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:08.983354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:08.984021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:08.984332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:08.985756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.004565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 516/1051] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:09.006581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.044512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.116288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110485a7-4e6b-49ec-94f0-6c81dfecf6f6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:09.154656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:09.155298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.155627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.155860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.163718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:09.165102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:31:09.176539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:09.178209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:09.179308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:09.182458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 536/1052] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:09.183968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.287672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e03a6-17e7-4980-aa8d-54a371cd0e10 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:09.314743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.323976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:09.324581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.324860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.325130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.325853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:09.326195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:09.327621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.345321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 517/1053] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:09.351493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.455787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.464449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb6a0-6d12-4234-a0ec-b3ba76c32e19 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:09.500986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:09.501622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.501903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.502207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.513098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:09.514601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:09.529682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:09.530951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:09.531905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:09.531905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:09.531905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:09.534387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 537/1054] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:31:09.536596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.639829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeaa32-5f63-40f3-bf6c-1bd7eef98cbf None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:09.675625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:09.676228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.676504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.676770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.677406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:09.678257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:09.679633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b9cb-0269-48c4-be19-533d11da1ea9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.691492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 518/1055] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:09.697469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.812924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16599a4c-896a-4025-8e30-4124c8a493d7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:09.854558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf038-c47e-49ab-b9ab-74cfc8e821f1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.854933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf038-c47e-49ab-b9ab-74cfc8e821f1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.855273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cf038-c47e-49ab-b9ab-74cfc8e821f1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.856816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 519/1056] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:09.856938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:09.857406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.857685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.857961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.863482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9f518-0eb1-4805-b90c-574ff83d7a68 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.863842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9f518-0eb1-4805-b90c-574ff83d7a68 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.864122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9f518-0eb1-4805-b90c-574ff83d7a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.865335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:09.866811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:31:09.878325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:09.879501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:09.883246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 538/1057] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:09.885159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:09.888281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39b9f518-0eb1-4805-b90c-574ff83d7a68 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:09.889494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39b9f518-0eb1-4805-b90c-574ff83d7a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:09.898604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.939517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:09.970475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 520/1058] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:09.981376 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6d6-ba8e-4616-bedf-6c738b8f40ae None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.981659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6d6-ba8e-4616-bedf-6c738b8f40ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.981934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5f6d6-ba8e-4616-bedf-6c738b8f40ae None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:09.983436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 521/1059] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:31:09.988828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:09.989111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:09.989384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.005350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989cdb9-3d15-45be-9a25-2f902b66c83f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.008747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:10.009954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:10.046448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.047125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.047391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.047725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.048522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:10.048882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.050472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.063410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 539/1060] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:10.069718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.093924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 522/1061] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:10.142433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.179424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07dabd-84e9-4dfd-826c-654a9ff25bc2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.214685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.215404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.215685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.215959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/0dd4a66b1073432fb72c5d2325056045` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.218263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=f3a5ff3f106248c4ae80b6bc74e0d8f2, role_id=0dd4a66b1073432fb72c5d2325056045)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.219847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.234576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 540/1062] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:31:10 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/f3a5ff3f106248c4ae80b6bc74e0d8f2/roles/0dd4a66b1073432fb72c5d2325056045 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:31:10.243453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.356794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8dcae-9b21-4731-9566-6487122571e2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.364989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.379400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.399994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.400694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.400987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.401299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] PATH_INFO: `/v3/services/image` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.401956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.403488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:10.414955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:10.416169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:10.417542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 523/1063] 10.222.0.52 () {56 vars in 1105 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:10.422811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.503299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267e7e3-c1a8-4576-b477-6634c80e9af5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.534739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.543698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1cc38-c55b-4e55-bf55-086006d2668d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.547216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.547864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.548146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.548420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.560316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:10.565073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:10.566053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:10.566921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:10.570285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 541/1064] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:31:10.572147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.583062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.583675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.584495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.584772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.585408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:10.585716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.587130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.592637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 524/1065] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:10.598287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.634100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.690262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b6d-01c7-4756-9c23-ed0f616a910c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.721027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08607378-d90e-41e9-98af-b0407820d4b5 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.725526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.726170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.726454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.726731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.727405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:10.727709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.729076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.737634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 542/1066] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:10.743454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.760066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.760702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.760980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.761251 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.761879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] RBAC: Adding query filter params (type=image) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:10.762314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.763653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.769058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 525/1067] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:10.775894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.802682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.864267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f15f57-4755-465e-93f7-cf035588592c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.890180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:10.894648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff767e19-aee1-4278-b61c-cc3e11b4d5ff None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:10.905811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.906556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.906875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.907317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] PATH_INFO: `/v3/users/dede6528ec3d493ba782e5e7e9326838` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.923222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] RBAC: Authorizing `identity:get_user(user_id=dede6528ec3d493ba782e5e7e9326838)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.924840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.926884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 543/1068] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/users/dede6528ec3d493ba782e5e7e9326838 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:10.932139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:10.932758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:10.932971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:10.933097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:10.933352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:10.933944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:10.935371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:10.956692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 526/1069] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:31:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:31:11.054093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8493dd-8e4f-4b71-99d7-5f48499479f2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:11.065239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:11.102411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:11.103032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:11.103316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:11.103646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:11.178636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:11.179986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:11.286163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 544/1070] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:31:11.289705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:11.398338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f9476-3c58-4fde-aa4a-3891fc3793d6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:11.435302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:11.435861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:11.436139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:11.436409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:11.437540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:11.439007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d36e-9b16-43a7-bfa9-ba166e2a75af None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:11.445869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 527/1071] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:11 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:11.447540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:11.451057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:11.551391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e7628-f9ca-42e1-8e9a-1420d21ceaf4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:11.590954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:11.591648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:11.591972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:11.592274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:11.593107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=9aae2a5c83fb47f59755efe6cec195ab, user.id=dede6528ec3d493ba782e5e7e9326838) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:11.593444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:11.595127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e877ae-65b8-454d-be08-bc252a744430 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:11.610413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 545/1072] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:11 2022] GET /identity/v3/role_assignments?user.id=dede6528ec3d493ba782e5e7e9326838&scope.project.id=9aae2a5c83fb47f59755efe6cec195ab&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:12.163715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3fd2-1eff-482c-a075-0a6470a252b6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.164241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3fd2-1eff-482c-a075-0a6470a252b6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.164241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e3fd2-1eff-482c-a075-0a6470a252b6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.165840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 528/1073] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:12.171452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106d3-8970-4613-bf58-06166b176307 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.171958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106d3-8970-4613-bf58-06166b176307 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.172040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106d3-8970-4613-bf58-06166b176307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.190765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c50106d3-8970-4613-bf58-06166b176307 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:12.191954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c50106d3-8970-4613-bf58-06166b176307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:12.262536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:12.270102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 546/1074] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:12.539016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e3fd2-1eff-482c-a075-0a6470a252b6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:12.564977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:12.650107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e3fd2-1eff-482c-a075-0a6470a252b6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:12.684906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:12.685541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.685817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.686100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.697422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-6d04161f-c633-49fa-9801-78cb940e987e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:12.702239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:12.703299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 10:31:12.704342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:12.706419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 529/1075] 10.222.0.52 () {56 vars in 1120 bytes} [Wed Aug 24 10:31:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:12.709600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50106d3-8970-4613-bf58-06166b176307 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:12.822771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50106d3-8970-4613-bf58-06166b176307 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:12.866342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:12.867373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.867859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.868355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.869294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:12.869851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:12.871583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:12.882216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 547/1076] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:31:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:12.884360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c0b1-433b-444c-814d-777d05ba8fde None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.884652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c0b1-433b-444c-814d-777d05ba8fde None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.884956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29c0b1-433b-444c-814d-777d05ba8fde None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.886612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 530/1077] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:12.887683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:12.892122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:12.892433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:12.893028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:12.913207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:12.914781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:12.957093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:12.997874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 531/1078] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:13.001149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ab505-ee47-4ed5-b176-ec08a1307db0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.040020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.040790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.041093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.041404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.053914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.055600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:13.071427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:13.072361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:13.073283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:13.073283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:13.073283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:13.073283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 548/1079] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:13.079721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.093926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.185315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec521f2-5166-44a4-b700-71ececacb849 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.221861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.222675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.222980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.223287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.224005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:13.224844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.226390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.244635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 532/1080] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:13.246264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.292514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.353263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1502-b099-4a7f-9aec-e11d302d9d07 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.366451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.368851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.394012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.394773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.395050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.395436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.398743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d641a55-a41c-4629-ad82-cecc61f029f8 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.404085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.405859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:31:13.418457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:13.419759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:13.421085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 549/1081] 10.222.0.52 () {56 vars in 1093 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:13.425425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.438106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.438724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.439008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.439278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.510567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.512208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e037202-c115-4074-964c-ff5d45b52bff None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.535747 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7654-9ae2-4357-8c14-0cf8d003e828 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.576332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.577035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.577374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.577651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.578571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:13.578964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.580566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62c997-5732-483a-8aa3-3d3f27848bec None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.590599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.599815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 550/1082] 10.222.0.52 () {56 vars in 1133 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:13.601684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a1d2-b590-4d7b-b494-d70ff988e616 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.601985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a1d2-b590-4d7b-b494-d70ff988e616 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.602273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a1d2-b590-4d7b-b494-d70ff988e616 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.603694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 551/1083] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:13.605553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3a1d2-b590-4d7b-b494-d70ff988e616 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.626105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 533/1084] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:31:13.626585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.626871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.627140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.636021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.644968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:13.646738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:13.710645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3a1d2-b590-4d7b-b494-d70ff988e616 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.713851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 534/1085] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:13.714726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.757438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.758168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.758493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.758800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.824916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d764-a989-4e96-b5df-25cb1184aa20 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:13.826609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.850753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.852396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.868742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:13.869288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:13.869563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:13.869817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:13.880092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:13.881581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:13.890884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:13.896492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:13.897729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:13.898661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:13.898661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:13.898661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:13.898661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 535/1086] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:13.904152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:13.983057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 552/1087] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:31:13.989582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.010892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac6cdb-35fd-4ef4-bb89-c265b31a3cce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.045359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.045963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.046265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.046527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.047167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:14.047469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.048834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.061260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 536/1088] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.062093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.080161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.105163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33e28-4dc5-4f9b-abf3-db224af796d6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.142243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.150396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.151060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.151340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.151640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.162852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.164460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:14.181684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:14.182959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:31:14.183863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:14.183863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:31:14.183863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:14.183863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 553/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:31:14.189534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.195640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2d6f8-de50-4572-b1fc-8f0f53b30899 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.241754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.242430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.243227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.243227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.254053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:14.258915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:14.259845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:14.260672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 537/1090] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:14.266158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.320455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c50a9-08f4-4c65-a537-212adab49cf0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.359457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.363587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.364209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.364491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.364770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.365449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:14.365756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.367242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.379723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 554/1091] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:14.385511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.386937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c618b-2914-4615-b1b3-518423099fce None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.423998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.424580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.424871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.425152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.425861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:14.426226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.427799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.430784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.437569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 538/1092] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.443327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.495227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee949-2557-4dd0-a276-32f01eafe5d0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.535254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.535896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.536175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.536451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.543920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.545365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.549088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244221f-90eb-4e31-8fb4-6ad09e3b4741 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:31:14.557158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:14.558367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:14.559497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 555/1093] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:31:14.565121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.585641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.586298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.586578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.586864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] PATH_INFO: `/v3/users/dede6528ec3d493ba782e5e7e9326838` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.587993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] RBAC: Authorizing `identity:get_user(user_id=dede6528ec3d493ba782e5e7e9326838)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.589416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.591041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 539/1094] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/users/dede6528ec3d493ba782e5e7e9326838 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.596791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.600921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.672776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd976-1688-43a1-8c86-a15fa5cb07e4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.674652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.701653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddca90-6f5f-46ff-8862-12f7181a11f0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.715024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.715642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.715922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.716202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.716896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:14.717203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.718661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.731744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 556/1095] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.735345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.735966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.736233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.736501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.737591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.737714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.739048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.746892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 540/1096] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.747908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:14.821897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:14.837625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb2cee-8446-4c28-8224-e51ad930ca9a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.856898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84961685-7c0c-4cd0-9ea7-1c6c3ea135bb None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:14.874686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.875303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.875574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.875845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.876566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] RBAC: Adding query filter params (role.id=0dd4a66b1073432fb72c5d2325056045, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:14.876871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.878314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee99597-0240-4c58-b538-54e9c455aee9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.884058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 557/1097] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:14 2022] GET /identity/v3/role_assignments?user.id=f3a5ff3f106248c4ae80b6bc74e0d8f2&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=0dd4a66b1073432fb72c5d2325056045 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:14.900470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:14.901164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:14.901452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:14.901724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab/users/dede6528ec3d493ba782e5e7e9326838/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:14.903800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9aae2a5c83fb47f59755efe6cec195ab, user_id=dede6528ec3d493ba782e5e7e9326838, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:14.905274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a17d66-c256-4ed9-a4c9-4561ea7e9ae7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:14.920930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 541/1098] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:31:14 2022] PUT /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab/users/dede6528ec3d493ba782e5e7e9326838/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:31:16.821785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f608-c345-4fe8-a19a-afd5cfca72b7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:16.822530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f608-c345-4fe8-a19a-afd5cfca72b7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:16.822530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774f608-c345-4fe8-a19a-afd5cfca72b7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:16.823784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 558/1099] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:16.830688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:16.831079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:16.831293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:16.853546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:16.854909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:16.923308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 542/1100] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:17.196330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f608-c345-4fe8-a19a-afd5cfca72b7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:17.226690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:17.306144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774f608-c345-4fe8-a19a-afd5cfca72b7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:17.342949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:17.343605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:17.343885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:17.344160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:17.355000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:17.359655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:17.360769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:17.361806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 559/1101] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:17.367496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:17.427136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:17.469346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dbed2-596a-4b99-bc6d-ffea0039086d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:17.502304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:17.502900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:17.503176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:17.503444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:17.504094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:17.504393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:17.506356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:17.514266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 543/1102] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:17.523036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:17.605916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:17.621547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568969-49f7-414a-80ed-e954420efba8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:17.654260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:17.654879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:17.655155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:17.655423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] PATH_INFO: `/v3/users/dede6528ec3d493ba782e5e7e9326838` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:17.656520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] RBAC: Authorizing `identity:get_user(user_id=dede6528ec3d493ba782e5e7e9326838)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:17.657941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:17.659523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 560/1103] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:17 2022] GET /identity/v3/users/dede6528ec3d493ba782e5e7e9326838 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:17.668587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:17.767221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3cc5-bff2-42cb-a27a-43e6a0463731 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:17.790097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:17.810047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:17.810679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:17.810959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:17.811230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:17.884577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:17.886038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:17.996566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 544/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:18.002709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:18.119140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679b9b-f7f4-4e39-9ba6-730d05d73b7c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:18.156199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:18.156839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:18.157119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:18.157390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:18.158517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:18.159933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f50f6-4d9a-41bd-85a2-0ad37f05187f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:18.161562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 561/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:18 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:18.167853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:18.192238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:18.265285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d5d3-baf5-4503-b04e-08d89c48dae0 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:18.298218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:18.298804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:18.299075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:18.299338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:18.300049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=9aae2a5c83fb47f59755efe6cec195ab, user.id=dede6528ec3d493ba782e5e7e9326838) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:18.300354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:18.301766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444aadf-8052-4834-8272-ba071af21cc7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:18.307908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 545/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:18 2022] GET /identity/v3/role_assignments?user.id=dede6528ec3d493ba782e5e7e9326838&scope.project.id=9aae2a5c83fb47f59755efe6cec195ab&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:20.201813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb49-3283-4ce7-a837-59781670eb9d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:20.202426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb49-3283-4ce7-a837-59781670eb9d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:20.202426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb49-3283-4ce7-a837-59781670eb9d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:20.203739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 562/1107] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:20.208977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:20.209405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:20.209537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:20.227069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:20.228241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:20.294719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 546/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:20.563992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fb49-3283-4ce7-a837-59781670eb9d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:20.588987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:20.666832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fb49-3283-4ce7-a837-59781670eb9d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:20.701026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:20.701655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:20.701936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:20.702242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:20.703347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:20.704782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57844-338b-4f8e-a5c0-ab8c50b093e5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:20.706371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 563/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:20.712227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:20.730507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:20.808889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a92b9-3c2f-499d-a7e6-8560187d98ff None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:20.841101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:20.841695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:20.841977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:20.842268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:20.842919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:20.844338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a4cea-c5f5-40d1-9346-42e7a8a50804 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:20.866650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 547/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:31:20 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:22.786847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16c5b3-1aea-4302-a5f1-0e3d4ad8b76d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:22.790319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16c5b3-1aea-4302-a5f1-0e3d4ad8b76d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:22.790319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16c5b3-1aea-4302-a5f1-0e3d4ad8b76d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:22.790319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 564/1111] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:22.794902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:22.795346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:22.795444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:22.812883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:22.814052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:22.879890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 548/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:23.146429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16c5b3-1aea-4302-a5f1-0e3d4ad8b76d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:23.234379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:23.245739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16c5b3-1aea-4302-a5f1-0e3d4ad8b76d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:23.278847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:23.279467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:23.279743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:23.280016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] PATH_INFO: `/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:23.281377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] RBAC: Authorizing `identity:get_role(role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:23.282756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:23.284070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 565/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:23 2022] GET /identity/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:23.290003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:23.293210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:23.387523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3b95f-8dd6-4d28-9493-9e898933a961 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:23.420302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:23.420845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:23.421118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:23.421380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] PATH_INFO: `/v3/users/dd4550121ac24de688dc59e5345e9a07` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:23.434534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4550121ac24de688dc59e5345e9a07)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:23.435962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:23.437560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 549/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:23 2022] GET /identity/v3/users/dd4550121ac24de688dc59e5345e9a07 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:23.444575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:23.540081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c51f21-8e45-4ea9-9680-ca6d869d1ed7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:23.572333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:23.572936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:23.573215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:23.573484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:23.598641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:23.638786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:23.640217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:23.735269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 566/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:23.741788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:23.801124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:23.839779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7b97c-7a82-406c-9a73-7190ec978191 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:23.875411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:23.876031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:23.876302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:23.876568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:23.877673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:23.879129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647733ba-7cfa-450c-a43a-22e863edf58b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:23.880755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 550/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:23 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:23.889597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:23.946332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:23.987643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d83c-bb6c-4134-beab-f95ae0706788 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:24.019663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:24.020260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:24.020537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:24.021380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:24.022385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=9aae2a5c83fb47f59755efe6cec195ab, user.id=dd4550121ac24de688dc59e5345e9a07) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:24.022690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:24.024098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde43de2-3d8c-4780-8be6-98b2caf22bfe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:24.029405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 567/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:23 2022] GET /identity/v3/role_assignments?user.id=dd4550121ac24de688dc59e5345e9a07&scope.project.id=9aae2a5c83fb47f59755efe6cec195ab&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:31:25.907493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452a2d-32aa-42dd-9e04-6ea0c7b8ea80 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:25.908017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452a2d-32aa-42dd-9e04-6ea0c7b8ea80 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:25.908017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81452a2d-32aa-42dd-9e04-6ea0c7b8ea80 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:25.909381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 551/1118] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:25.914828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:25.915275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:25.915420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:25.933131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:25.934343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:25.999081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 568/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:26.266845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81452a2d-32aa-42dd-9e04-6ea0c7b8ea80 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:26.367399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81452a2d-32aa-42dd-9e04-6ea0c7b8ea80 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:26.395722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:26.402200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:26.402822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:26.403103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:26.403371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] PATH_INFO: `/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:26.404762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] RBAC: Authorizing `identity:get_role(role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:26.406154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:26.407491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 552/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:26 2022] GET /identity/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:26.413518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:26.467578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:26.516462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30a55-7a14-4847-8498-548b29e2fe6d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:26.550217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:26.550721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:26.551001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:26.551270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] PATH_INFO: `/v3/users/dd4550121ac24de688dc59e5345e9a07` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:26.553021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4550121ac24de688dc59e5345e9a07)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:26.554484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:26.556062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 569/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:26 2022] GET /identity/v3/users/dd4550121ac24de688dc59e5345e9a07 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:26.561995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:26.657387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede04da-b621-47da-956f-59fdfb358b61 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:26.691153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:26.691765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:26.692040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:26.692303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:26.693422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:26.694870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d3c8a-fc42-4f2d-a0cf-c8d077814888 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:26.696499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 553/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:26 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:26.702572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:26.798000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb3a5c-df38-4721-9d8a-9604d8479ea6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:26.818289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:26.832444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:26.833110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:26.833394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:26.833673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab/users/dd4550121ac24de688dc59e5345e9a07/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:26.835899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] RBAC: Authorizing `identity:create_grant(project_id=9aae2a5c83fb47f59755efe6cec195ab, user_id=dd4550121ac24de688dc59e5345e9a07, role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:26.837344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad02de3-1182-485f-a621-3e1f7197464b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:26.851755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 570/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:31:26 2022] PUT /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab/users/dd4550121ac24de688dc59e5345e9a07/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:31:28.723302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33ca9-d63a-4108-8020-035478b2320d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:28.723840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33ca9-d63a-4108-8020-035478b2320d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:28.723986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b33ca9-d63a-4108-8020-035478b2320d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:28.725422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 554/1124] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:28.731065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:28.731528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:28.731624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:28.749973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:28.751219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:28.817633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 571/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:29.082444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33ca9-d63a-4108-8020-035478b2320d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:29.151106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:29.187201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b33ca9-d63a-4108-8020-035478b2320d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:29.220783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:29.221401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:29.221678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:29.221948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] PATH_INFO: `/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:29.223375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] RBAC: Authorizing `identity:get_role(role_id=5f0f7ccaf0e8436d914528dedd5686e7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:29.224739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:29.226083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 555/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:29 2022] GET /identity/v3/roles/5f0f7ccaf0e8436d914528dedd5686e7 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:29.231987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:29.328785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd189dee-06cc-472d-830d-0b582bef1555 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:29.339377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:29.362953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:29.363586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:29.363868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:29.364145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] PATH_INFO: `/v3/users/dd4550121ac24de688dc59e5345e9a07` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:29.365790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4550121ac24de688dc59e5345e9a07)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:29.367275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:29.368871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 572/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:29 2022] GET /identity/v3/users/dd4550121ac24de688dc59e5345e9a07 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:29.374791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:29.472106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326c6e8-bd05-46ae-b99c-00ef5f5dadbe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:29.505674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:29.506290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:29.506562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:29.506828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:29.509475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:29.574466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:29.575904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:29.673517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 556/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:29.680230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:29.776208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e91f-cae3-48a8-9656-0cfca386e0e8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:29.809530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:29.810179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:29.810462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:29.810736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] PATH_INFO: `/v3/projects/9aae2a5c83fb47f59755efe6cec195ab` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:29.811831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] RBAC: Authorizing `identity:get_project(project_id=9aae2a5c83fb47f59755efe6cec195ab)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:29.813253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791d701-9ef9-47f9-927d-361d5fd0dff7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:29.814900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 573/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:29 2022] GET /identity/v3/projects/9aae2a5c83fb47f59755efe6cec195ab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:29.821208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:29.857466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:29.924055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261950f-5500-4376-b943-0f3ee699b44a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:29.964520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:29.965117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:29.965392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:29.965662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:29.966409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] RBAC: Adding query filter params (role.id=5f0f7ccaf0e8436d914528dedd5686e7, scope.project.id=9aae2a5c83fb47f59755efe6cec195ab, user.id=dd4550121ac24de688dc59e5345e9a07) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:29.966715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:29.968139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869ea46-b1c7-45cc-8550-cbd67e4f5d0c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:29.974457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 557/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:29 2022] GET /identity/v3/role_assignments?user.id=dd4550121ac24de688dc59e5345e9a07&scope.project.id=9aae2a5c83fb47f59755efe6cec195ab&role.id=5f0f7ccaf0e8436d914528dedd5686e7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:31.877467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e32ea-00da-486c-abd7-f81cba043dd8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:31.877986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e32ea-00da-486c-abd7-f81cba043dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:31.878098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e32ea-00da-486c-abd7-f81cba043dd8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:31.879460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 574/1131] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:31.886026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:31.886445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:31.886590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:31.905791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:31.907099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:31.978047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 558/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:32.241788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e32ea-00da-486c-abd7-f81cba043dd8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:32.289636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:32.343447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e32ea-00da-486c-abd7-f81cba043dd8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:32.378152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:32.378782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:32.379057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:32.379325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:32.380959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:32.382402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb7cf-afaa-4349-8f45-62b7addb343c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:32.383952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 575/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:32.390040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:32.417910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:32.492225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438113d2-8574-4ff1-8b82-88dc361e3889 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:32.528558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:32.529161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:32.529437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:32.529707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:32.530389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:32.531816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c250b-156f-46fa-8b5e-e60b72ad5575 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:32.560050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 559/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:31:32 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:34.512091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e418c9-4efc-4f2f-8865-49e549c70408 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:34.512907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e418c9-4efc-4f2f-8865-49e549c70408 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:34.513087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e418c9-4efc-4f2f-8865-49e549c70408 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:34.514545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 576/1135] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:34.520162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:34.521083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:34.521536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:34.540660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:34.541904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:34.608723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 560/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 10:31:34.885237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e418c9-4efc-4f2f-8865-49e549c70408 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:34.986372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e418c9-4efc-4f2f-8865-49e549c70408 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:35.000793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:35.023121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:35.023942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:35.024259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:35.024685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:35.026257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:35.027980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091825-1fc1-41a6-8f47-1800764eb007 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:35.029612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 577/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:35.035540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:35.047772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:35.136572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8665f96-0bb2-4840-ae8f-0ef5823186dd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:35.170654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:35.171277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:35.171590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:35.171891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:35.172560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:35.174028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89cef-c65d-4b79-8d52-918de3cad7c6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:35.195341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 561/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:31:35 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:37.133329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748699f-4c2d-43a9-b0b2-62e5848a4d77 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:37.133893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748699f-4c2d-43a9-b0b2-62e5848a4d77 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:37.133893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748699f-4c2d-43a9-b0b2-62e5848a4d77 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:37.135148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 578/1139] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:37.140471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:37.140912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:37.141097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:37.160139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:37.161391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:37.220725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:37.229656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 562/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:37.503391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748699f-4c2d-43a9-b0b2-62e5848a4d77 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:37.603009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748699f-4c2d-43a9-b0b2-62e5848a4d77 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:37.637441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:37.638092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:37.638389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:37.638666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:37.648909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:37.653671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:37.654872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:37.655814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 579/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:37.661005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:37.760577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e505d-3a17-450d-927f-cbe66123a3ca None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:37.794935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:37.795544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:37.795852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:37.796153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:37.796838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:37.797172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:37.798593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:37.807387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 563/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:37.813389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:37.858568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:37.914564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d321f96-d661-4378-9af2-9877a0a40bc8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:37.947891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:37.948518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:37.948794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:37.949064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] PATH_INFO: `/v3/users/5a2fde0e69284cf9be22c95285a2ff60` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:37.962447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2fde0e69284cf9be22c95285a2ff60)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:37.963879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:37.965493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 580/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:37 2022] GET /identity/v3/users/5a2fde0e69284cf9be22c95285a2ff60 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:37.971747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:38.032487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:38.075830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ee85c-c76a-4d20-ae9a-3834f6b52e77 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:38.108590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:38.109202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:38.109519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:38.109820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:38.175337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:38.177316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:38.231602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:38.274652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 564/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:38.280996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:38.378471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:38.382694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a5859-853c-4172-9436-d6a4b09cce07 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:38.416671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:38.417300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:38.417576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:38.417844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] PATH_INFO: `/v3/projects/d68d2c76429d4ab5a56f4351a1e17689` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:38.418963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d2c76429d4ab5a56f4351a1e17689)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:38.421141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041b19-a33d-41ca-9770-f19af3feff97 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:38.422795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 581/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:38 2022] GET /identity/v3/projects/d68d2c76429d4ab5a56f4351a1e17689 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:38.429651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:38.531482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832883-e4ec-4c92-932b-6bf7a37366aa None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:38.566389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:38.567010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:38.567289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:38.567558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:38.568277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=d68d2c76429d4ab5a56f4351a1e17689, user.id=5a2fde0e69284cf9be22c95285a2ff60) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:38.568581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:38.570001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b60b-b938-4367-958f-8ac572216220 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:38.575403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 565/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:38 2022] GET /identity/v3/role_assignments?user.id=5a2fde0e69284cf9be22c95285a2ff60&scope.project.id=d68d2c76429d4ab5a56f4351a1e17689&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:40.474985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d25b6-0816-4c38-af66-20ce955f57d4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:40.475540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d25b6-0816-4c38-af66-20ce955f57d4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:40.475633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d25b6-0816-4c38-af66-20ce955f57d4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:40.477228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 582/1147] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:40.482953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:40.483445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:40.483569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:40.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:40.502561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:40.519015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:40.569574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 566/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:40.839872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d25b6-0816-4c38-af66-20ce955f57d4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:40.937824 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d25b6-0816-4c38-af66-20ce955f57d4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:40.971226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:40.971845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:40.972122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:40.972389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:40.982207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:40.987272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:40.988399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:40.989485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 583/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:40.995143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:41.092335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4510c-a2d5-489b-bb54-64d9b016e0b4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:41.125419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:41.126044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:41.126532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:41.126806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:41.127503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:41.127806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:41.129179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:41.137895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 567/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:41.143894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:41.173187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:41.242534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b1428-dec4-498a-82be-6f2233923702 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:41.275555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:41.276188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:41.276469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:41.276741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] PATH_INFO: `/v3/users/5a2fde0e69284cf9be22c95285a2ff60` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:41.277853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2fde0e69284cf9be22c95285a2ff60)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:41.279318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:41.280888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 584/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:41 2022] GET /identity/v3/users/5a2fde0e69284cf9be22c95285a2ff60 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:41.286963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:41.303534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:41.386459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4baec4-bbce-4cd5-8842-49cc47d4f748 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:41.421367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:41.422008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:41.422300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:41.422567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] PATH_INFO: `/v3/projects/d68d2c76429d4ab5a56f4351a1e17689` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:41.423662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d2c76429d4ab5a56f4351a1e17689)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:41.425079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068eeb9-5661-41e0-9fba-594db4ee2e00 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:41.426737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 568/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:41 2022] GET /identity/v3/projects/d68d2c76429d4ab5a56f4351a1e17689 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:41.432884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:41.525856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:41.532614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e893-d859-40aa-a2aa-add609801fb1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:41.565552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:41.566250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:41.566535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:41.567337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] PATH_INFO: `/v3/projects/d68d2c76429d4ab5a56f4351a1e17689/users/5a2fde0e69284cf9be22c95285a2ff60/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:41.569215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] RBAC: Authorizing `identity:create_grant(project_id=d68d2c76429d4ab5a56f4351a1e17689, user_id=5a2fde0e69284cf9be22c95285a2ff60, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:41.570678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a9704-3141-4125-8db0-ef5aab51574b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:41.585602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 585/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:31:41 2022] PUT /identity/v3/projects/d68d2c76429d4ab5a56f4351a1e17689/users/5a2fde0e69284cf9be22c95285a2ff60/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:31:43.454671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aa48-7cf0-4b42-8422-67f5fd9b5aa4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:43.455247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aa48-7cf0-4b42-8422-67f5fd9b5aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:43.455247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493aa48-7cf0-4b42-8422-67f5fd9b5aa4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:43.456545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 569/1154] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:43.462364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:43.462818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:43.462941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:43.480638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:43.481835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:43.550408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 586/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:43.819662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493aa48-7cf0-4b42-8422-67f5fd9b5aa4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:43.905342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:43.925340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493aa48-7cf0-4b42-8422-67f5fd9b5aa4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:43.958918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:43.959540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:43.959819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:43.960090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:43.970534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:43.975776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:43.977005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:43.977929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 570/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:43.983016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:44.066688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:44.083382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57458177-e40f-4d74-9610-05938b7ec2d9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:44.121945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:44.122585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:44.122868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:44.123144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:44.123811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:44.124116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:44.125540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:44.134297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 587/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:44.140227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:44.251415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ff7c1-02fb-4854-988c-2e8141650a6e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:44.284232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:44.284842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:44.285111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:44.285413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] PATH_INFO: `/v3/users/5a2fde0e69284cf9be22c95285a2ff60` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:44.286539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] RBAC: Authorizing `identity:get_user(user_id=5a2fde0e69284cf9be22c95285a2ff60)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:44.288155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:44.289727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 571/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:44 2022] GET /identity/v3/users/5a2fde0e69284cf9be22c95285a2ff60 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:44.295856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:44.396439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f2cd4-032b-4d3c-a715-015fffd726ab None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:44.429030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:44.429640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:44.429924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:44.430236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:44.447916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:44.498402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:44.500035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:44.602945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 588/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 10:31:44.609128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:44.622437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:44.712191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe7bf-f7d9-4942-81c8-8227ca8c7a35 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:44.744940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:44.745560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:44.745836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:44.746123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] PATH_INFO: `/v3/projects/d68d2c76429d4ab5a56f4351a1e17689` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:44.747227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] RBAC: Authorizing `identity:get_project(project_id=d68d2c76429d4ab5a56f4351a1e17689)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:44.748655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65588458-f62e-40fe-abde-ba3562ee6d24 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:44.750325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 572/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:44 2022] GET /identity/v3/projects/d68d2c76429d4ab5a56f4351a1e17689 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:44.757070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:44.805289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:44.856762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aede18-4b68-456b-80db-5fe4c3551044 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:44.890047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:44.890664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:44.890941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:44.891211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:44.891919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=d68d2c76429d4ab5a56f4351a1e17689, user.id=5a2fde0e69284cf9be22c95285a2ff60) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:44.892225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:44.893636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a7ef-8501-435a-bcd9-d82d12db2e8b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:44.900046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 589/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:44 2022] GET /identity/v3/role_assignments?user.id=5a2fde0e69284cf9be22c95285a2ff60&scope.project.id=d68d2c76429d4ab5a56f4351a1e17689&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:46.858893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae365ba-c675-4d9d-9371-11a094a33b5c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:46.859435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae365ba-c675-4d9d-9371-11a094a33b5c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:46.859435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae365ba-c675-4d9d-9371-11a094a33b5c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:46.860761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 573/1162] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:46.866167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:46.866610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:46.866767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:46.885059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:46.886286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:46.951769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 590/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:47.219633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae365ba-c675-4d9d-9371-11a094a33b5c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:47.299096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:47.321888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae365ba-c675-4d9d-9371-11a094a33b5c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:47.355957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:47.356557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:47.356834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:47.357120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:47.423421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:47.424869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:47.499800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:47.522054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 574/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:47.528188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:47.570209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:47.623316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cf96-f43d-4390-ab01-0b19aeff3719 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:47.656434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:47.657049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:47.657324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:47.657591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:47.664033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:47.665456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-84ee600f-ed48-44d5-8c82-945401d0abdb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:47.676405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:47.677622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:31:47.678763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 591/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:31:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:47.684295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:47.779551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb594-5d7b-4d1d-a2d1-3f92494ffe93 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:47.811494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:47.812080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:47.812354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:47.812619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:47.813241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:47.813535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:47.814919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e113eb-f58f-4bef-93ee-e38d591e0471 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:47.822607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 575/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Wed Aug 24 10:31:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:49.732979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10507-f2a6-43b9-8d95-ba67aed095f1 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:49.733511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10507-f2a6-43b9-8d95-ba67aed095f1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:49.733511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c10507-f2a6-43b9-8d95-ba67aed095f1 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:49.734916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 592/1167] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:49.740749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b32af-04b6-4020-9e1c-94912b6ddcac None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:49.741135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b32af-04b6-4020-9e1c-94912b6ddcac None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:49.741287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b32af-04b6-4020-9e1c-94912b6ddcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:49.759525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a81b32af-04b6-4020-9e1c-94912b6ddcac None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:49.760708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a81b32af-04b6-4020-9e1c-94912b6ddcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:49.795855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:49.827551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 576/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:50.094220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10507-f2a6-43b9-8d95-ba67aed095f1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:50.207493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c10507-f2a6-43b9-8d95-ba67aed095f1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:50.209358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:50.250974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:50.251582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:50.251863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:50.252134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:50.252808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:50.254201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd74d8b-b458-40df-a773-f6e446f57b5a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:50.272181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 593/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Wed Aug 24 10:31:50 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:52.252319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d938-6ff2-4594-9ca3-033cd9e466d1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:52.252876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d938-6ff2-4594-9ca3-033cd9e466d1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:52.252876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d938-6ff2-4594-9ca3-033cd9e466d1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:52.254758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 577/1170] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:52.259895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:52.260299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:52.260516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:52.278890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:52.280087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:52.344343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 594/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:52.608610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d938-6ff2-4594-9ca3-033cd9e466d1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:52.709055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d938-6ff2-4594-9ca3-033cd9e466d1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:52.741758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:52.742400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:52.742674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:52.742939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] PATH_INFO: `/v3/domains/04b2df98c41f416c99a9cda05e59258a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:52.752914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=04b2df98c41f416c99a9cda05e59258a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:52.754974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd03e-22e7-4814-b0f0-4b53f2a4b9ad None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:52.756552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 578/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Wed Aug 24 10:31:52 2022] GET /identity/v3/domains/04b2df98c41f416c99a9cda05e59258a => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:52.762463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:52.858746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:52.868790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069cda8-c9bc-4fdd-bf8a-5323606ebed7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:52.902287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:52.902891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:52.903165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:52.903541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:52.904187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:52.905600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15abc-7dde-4c2b-a4b9-a5e2d4a7f078 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:52.932034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 595/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:31:52 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:54.865829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a87f6-6933-4cb2-92f8-029cfea7b3a8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:54.866367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a87f6-6933-4cb2-92f8-029cfea7b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:54.866471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a87f6-6933-4cb2-92f8-029cfea7b3a8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:54.867744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 579/1174] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:54.873240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:54.873669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:54.873788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:54.891905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:54.893109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:54.959817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 596/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:55.226961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a87f6-6933-4cb2-92f8-029cfea7b3a8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:55.258035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:55.327096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a87f6-6933-4cb2-92f8-029cfea7b3a8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:55.359790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:55.360402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:55.360680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:55.360950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] PATH_INFO: `/v3/domains/04b2df98c41f416c99a9cda05e59258a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:55.362047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=04b2df98c41f416c99a9cda05e59258a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:55.364085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ea264-a7f5-4b72-81ec-b9b0a970aff4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:55.365637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 580/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Wed Aug 24 10:31:55 2022] GET /identity/v3/domains/04b2df98c41f416c99a9cda05e59258a => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:55.371230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:55.442286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:55.466699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828326d1-1af9-4401-8d0d-a400e1eedd02 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:55.499189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:55.499737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:55.500018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:55.500291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:55.500940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:55.502394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6cd6-3cd2-4713-9a4a-032726e06145 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:55.523362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 597/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:31:55 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:31:57.434663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82484ad-5978-40cd-8abd-8928a7e66d79 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:57.435214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82484ad-5978-40cd-8abd-8928a7e66d79 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:57.435214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82484ad-5978-40cd-8abd-8928a7e66d79 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:57.436533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 581/1178] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:31:57.442328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:57.442707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:57.442884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:57.460948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:31:57.462164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:31:57.525442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 598/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:31:57.794623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82484ad-5978-40cd-8abd-8928a7e66d79 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:57.890860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:57.894795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82484ad-5978-40cd-8abd-8928a7e66d79 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:57.927189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:57.927797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:57.928065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:57.928326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:57.938387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:31:57.943565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:31:57.944688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:31:57.945667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 582/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:31:57.950704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:58.007033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:58.049634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e670-bf25-4c63-a302-94c579081c11 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:58.082982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:58.083585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:58.083864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:58.084135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:58.084790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:58.085092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:58.086478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:58.094372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 599/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:58.100225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:58.196597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05db578-d203-4a70-b2bc-7b70ec734d56 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:58.229458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:58.230079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:58.230366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:58.230635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] PATH_INFO: `/v3/users/5433427816234cdcbe45d385f2f1435c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:58.243206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] RBAC: Authorizing `identity:get_user(user_id=5433427816234cdcbe45d385f2f1435c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:58.244627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:58.246235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 583/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:31:58 2022] GET /identity/v3/users/5433427816234cdcbe45d385f2f1435c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:58.251964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:58.357991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257468e-88a9-4aad-987f-da7ff7d66360 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:58.379759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:58.391409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:58.392006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:58.392284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:58.392553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:58.461178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:58.462620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:58.555806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 600/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:31:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:31:58.561667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:58.579985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:58.658302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a50f-ce6f-425e-9ddb-ce1d30327e22 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:58.690985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:58.691600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:58.691876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:58.692144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] PATH_INFO: `/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:58.693242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] RBAC: Authorizing `identity:get_project(project_id=f9d00d831cfb477fb0d7f56e0ecb3fd9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:58.694704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a3af5-1f11-4342-9968-84ff656cdc1a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:58.696304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 584/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:31:58 2022] GET /identity/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:31:58.702340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:31:58.726277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:31:58.800459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee34a4-e128-409e-aaa2-690df20f0423 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:31:58.836555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:31:58.837533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:31:58.837533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:31:58.837692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:31:58.838410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=f9d00d831cfb477fb0d7f56e0ecb3fd9, user.id=5433427816234cdcbe45d385f2f1435c) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:31:58.838716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:31:58.840122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a361f4f-0706-4281-bf82-7579c4221d4f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:31:58.845642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 601/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:31:58 2022] GET /identity/v3/role_assignments?user.id=5433427816234cdcbe45d385f2f1435c&scope.project.id=f9d00d831cfb477fb0d7f56e0ecb3fd9&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:00.721703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d731a-aae9-4841-b5ed-3e7138a81543 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:00.722288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d731a-aae9-4841-b5ed-3e7138a81543 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:00.722417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d731a-aae9-4841-b5ed-3e7138a81543 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:00.723765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 585/1186] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:00.728783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:00.729146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:00.729332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:00.747182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:00.748352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:00.811265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 602/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:32:01.080005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d731a-aae9-4841-b5ed-3e7138a81543 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.164908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.180213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d731a-aae9-4841-b5ed-3e7138a81543 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.212915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.213520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.213792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.214057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.223659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:32:01.228261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:32:01.229360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:32:01.230528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 586/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:32:01.235227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.251864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.333080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac422f8-d99e-4294-89d7-86a53b3d7fff None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.364611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.365203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.365478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.365750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.366436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:32:01.366737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:01.368080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:01.375659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 603/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:01.381959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.478665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724b90-4390-44a0-91ce-459352cfbedc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.513121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.513729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.514003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.514296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] PATH_INFO: `/v3/users/5433427816234cdcbe45d385f2f1435c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.515394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] RBAC: Authorizing `identity:get_user(user_id=5433427816234cdcbe45d385f2f1435c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:01.516815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:01.518403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 587/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:32:01 2022] GET /identity/v3/users/5433427816234cdcbe45d385f2f1435c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:01.524423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.599708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.620743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dad9-6846-4e09-b3a0-a39386bbcf1c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.653003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.653631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.653911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.654215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] PATH_INFO: `/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.655308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] RBAC: Authorizing `identity:get_project(project_id=f9d00d831cfb477fb0d7f56e0ecb3fd9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:01.656732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4aa7b-f13a-4d7f-adc3-cbf417f0a243 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:01.658357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 604/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:32:01 2022] GET /identity/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:01.664226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:01.680005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:01.762633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47f60a-0ad8-4124-8879-57e2551f145d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:01.795210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:01.795844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:01.796113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:01.796375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] PATH_INFO: `/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9/users/5433427816234cdcbe45d385f2f1435c/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:01.798302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=f9d00d831cfb477fb0d7f56e0ecb3fd9, user_id=5433427816234cdcbe45d385f2f1435c, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:01.799790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d394387-75c5-4ad7-8c1b-6c697c6a6fdd None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:01.813501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 588/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:32:01 2022] PUT /identity/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9/users/5433427816234cdcbe45d385f2f1435c/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:32:03.700011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c7e5d-163b-4077-99eb-c6c493db9a8b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:03.700592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c7e5d-163b-4077-99eb-c6c493db9a8b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:03.700592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c7e5d-163b-4077-99eb-c6c493db9a8b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:03.701894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 605/1193] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:32:03.707268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:03.707693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:03.707816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:03.725465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:32:03.726687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:32:03.791311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 589/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:32:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:32:04.063061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c7e5d-163b-4077-99eb-c6c493db9a8b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.163284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c7e5d-163b-4077-99eb-c6c493db9a8b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.195574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.196197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.196477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.196751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.207551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:32:04.212190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:32:04.213306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:32:04.214507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 606/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:32:04.219357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.222455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.315293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880da97c-cc68-4b97-bde1-f3bbd2225c53 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.351193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631db11-5222-4afc-959d-54873f536737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.351809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631db11-5222-4afc-959d-54873f536737 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.352086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631db11-5222-4afc-959d-54873f536737 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.352356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631db11-5222-4afc-959d-54873f536737 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.353035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631db11-5222-4afc-959d-54873f536737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:32:04.353335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631db11-5222-4afc-959d-54873f536737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:04.363782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631db11-5222-4afc-959d-54873f536737 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:04.374263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 590/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:04.380438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.390145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.488629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a7458-16fa-44e7-9856-190885bb4eb4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.525315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.525968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.526290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.526565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] PATH_INFO: `/v3/users/5433427816234cdcbe45d385f2f1435c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.527690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] RBAC: Authorizing `identity:get_user(user_id=5433427816234cdcbe45d385f2f1435c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:04.529123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:04.530764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 607/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/users/5433427816234cdcbe45d385f2f1435c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:32:04.537529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631db11-5222-4afc-959d-54873f536737 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.602270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.637071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631db11-5222-4afc-959d-54873f536737 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.669704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.670317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.670588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.670850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.734355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:04.735786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:04.796273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.830700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 591/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:32:04.837302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:04.909399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:04.933135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056e90-b3db-4fe5-b52f-4ecd0c13604a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:04.965589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:04.966234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:04.966516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:04.966790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] PATH_INFO: `/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:04.967881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=f9d00d831cfb477fb0d7f56e0ecb3fd9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:04.969299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625febb1-d04d-4ea3-9d45-49e247422ef4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:04.970926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 608/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/projects/f9d00d831cfb477fb0d7f56e0ecb3fd9 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:04.977000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:32:05.072605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791952b8-d7fa-4b79-bcbe-06fc0b3eb9ec None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:32:05.105600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:32:05.106214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:32:05.106490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:32:05.106754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:32:05.107467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=f9d00d831cfb477fb0d7f56e0ecb3fd9, user.id=5433427816234cdcbe45d385f2f1435c) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:32:05.107769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:32:05.109174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfd473-9549-402e-95f3-d6beff99eeb0 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:32:05.114774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 592/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:32:04 2022] GET /identity/v3/role_assignments?user.id=5433427816234cdcbe45d385f2f1435c&scope.project.id=f9d00d831cfb477fb0d7f56e0ecb3fd9&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:32:14.961708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=29 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:32:15.112734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:02.458006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483536-7fbd-43d7-9965-d8d4f25111a8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:02.458648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483536-7fbd-43d7-9965-d8d4f25111a8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:02.458648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483536-7fbd-43d7-9965-d8d4f25111a8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:02.460384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 609/1201] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:02.467271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:02.467848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:02.467848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:02.488296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:02.490019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:02.578104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 593/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:02.861883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483536-7fbd-43d7-9965-d8d4f25111a8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:03.005204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483536-7fbd-43d7-9965-d8d4f25111a8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:03.065335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:03.065985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:03.066308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:03.066588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:03.078306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:03.079754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:03.095954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:03.097014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:03.098214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:03.098214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:03.098214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:03.098214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 610/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:03.104041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:03.231888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f603b1-ca6d-4252-8921-0dc1a3fb228b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:03.268894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:03.275910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:03.276795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:03.277101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:03.277367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:03.278111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:03.278416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:03.280017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682f15-d750-42c1-8f0c-f3e527076921 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:03.297274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 594/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:03.304302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:03.399977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:03.467434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314a2f0-47de-4cce-b4c5-ad53fd7cbd49 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:03.508706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:03.509687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:03.510199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:03.510664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:03.511537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:03.513256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406eba0-4fea-460b-82c5-3ea4e6d0486a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:03.546617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 611/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Wed Aug 24 10:33:03 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:33:05.825182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024e07-9d0e-4e41-9d80-5498d7e2a339 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:05.825759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024e07-9d0e-4e41-9d80-5498d7e2a339 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:05.825759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024e07-9d0e-4e41-9d80-5498d7e2a339 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:05.827220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 595/1206] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:05.833583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:05.834091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:05.834321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:05.854764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:05.857104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:05.943830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 612/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:06.215016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024e07-9d0e-4e41-9d80-5498d7e2a339 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:06.339488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024e07-9d0e-4e41-9d80-5498d7e2a339 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:06.381103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:06.381803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.382137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.382437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.397293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:06.402328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:06.406841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:06.407761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 596/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:06.410239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:06.452395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:06.521943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59203c27-e02d-4fb4-88b2-3a8a677bde78 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:06.556891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:06.557498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.557775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.558043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.558784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:06.559088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:06.560447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:06.569318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 613/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:06.575093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:06.629831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:06.694623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2bcfd-ae87-4308-af40-06c8a24c31a3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:06.732830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:06.733552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.733830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.734119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.746277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:06.748113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:06.766162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:06.767498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:06.768884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:06.768884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:06.768884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:06.773117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 597/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:06.774250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:06.881416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:06.884698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83539a-232d-439d-aa45-a057fac3b26d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:06.923690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:06.924303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:06.924597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:06.924851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:06.925488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:06.925785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:06.927456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:06.940133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 614/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:06.946590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:07.067067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc1c03-5186-4b36-8a7f-34bd41b40cba None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:07.068648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:07.105252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:07.105881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.106193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.106462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.115205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:07.116676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:07.129840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:07.130991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:07.132162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:07.136922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 598/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:07.137082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:07.264578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d89c-c237-4305-8013-dbb3f8b42695 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:07.306514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:07.307265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.307595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.307877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.308777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:07.309231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:07.311041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:07.337494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 615/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:07.339355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:07.460178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9237e4-03de-4d17-82f5-a02d0c55aa7c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:07.501232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:07.501843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.502147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.502424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.536651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:07.587179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:07.589044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:07.717848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 599/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:33:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:33:07.724451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:07.743755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:07.843149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ad959-6faf-4bcd-92d2-0cae16a6ac7f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:07.884586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:07.886014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:07.886276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:07.886548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:07.897462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:07.898957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:07.919171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:07.920724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:07.922545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:07.922545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:07.922545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:07.924392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 616/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:33:07.930446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:07.994246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.039854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329422-cac5-4d26-b022-d1fad98609d7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:08.077910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:08.079222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.079555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.079824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.080474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:08.080773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:08.082195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:08.094057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 600/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:08.099543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:08.173008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.206856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4c03e-f3ed-4ef2-aedf-d29e28fc9819 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:08.243657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:08.244266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.244545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.244900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.251930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:08.253425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:08.270957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:08.272167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:08.273080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 617/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:33:08.278670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:08.415729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a217-11bf-46b3-91c9-d8855f0ac3fe None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:08.448116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.466399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:08.467009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.467315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.467643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.468712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:08.469097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:08.470582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018b57b-adf5-4622-a404-716d2d3d2cfa None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:08.485411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 601/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:08.491565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:08.605431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e657c1-be54-4961-b7ce-6ee1c4c380d8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:08.637664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:08.645512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:08.646141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:08.646422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:08.646693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:08.647424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=7e44512af18d47dcbd8f876b35dcb6d8) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:08.647821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:08.649704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a73ab7-c569-481d-a505-180cafa49818 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:08.655463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 618/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:33:08 2022] GET /identity/v3/role_assignments?user.id=7e44512af18d47dcbd8f876b35dcb6d8&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:33:10.593592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a072fbc-c6d6-4fea-883b-e5cbf211d28b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:10.594700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a072fbc-c6d6-4fea-883b-e5cbf211d28b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:10.594700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a072fbc-c6d6-4fea-883b-e5cbf211d28b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:10.596058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 602/1220] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:10.601481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:10.601890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:10.602052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:10.620688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:10.621997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:10.696523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 619/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:10.977781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a072fbc-c6d6-4fea-883b-e5cbf211d28b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.088144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a072fbc-c6d6-4fea-883b-e5cbf211d28b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:11.128597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:11.129279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:11.129585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:11.129931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:11.141605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:11.147014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:11.148125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:11.149030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 603/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:11.154648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.261758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39f342-cbe4-451f-93b0-82a57ab51c8d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:11.287389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:11.298652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:11.299327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:11.299673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:11.299953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:11.300618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:11.300922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:11.302334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:11.310738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 620/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:33:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:11.317422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.366005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:11.428765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf6011-9f33-4f36-ab02-f100c034e05f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:11.465231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:11.465912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:11.466227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:11.466496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:11.477311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:11.478798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:11.494896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:11.501322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:11.502269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:11.502269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:11.502269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:11.502269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 604/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:11.502522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.615355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf205d6-fde1-4d65-b040-b7885d852062 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:11.652648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:11.653352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:11.653719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:11.654052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:11.654932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:11.655318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:11.657408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:11.670662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 621/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:11.677279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.782051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:11.791626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cdb09-c518-4f2e-945c-d2adb67abd89 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:11.829620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:11.830505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:11.832523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:11.832783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:11.841547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:11.843105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:11.856412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:11.857571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:11.858734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 605/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:11.864221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:11.919136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:11.976019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42109e-4ecc-43cc-b437-8f93f4936580 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.011537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.012165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.012451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.012805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.013645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:12.013952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.016184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.041408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 622/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:12.042786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.152687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7c13c-43e7-429c-b1e2-83cb33592418 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.190335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.190970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.191315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.191638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.203410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.205184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:12.221082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:12.222262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:12.223157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:12.223157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:12.223157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:12.223157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 606/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:12.228500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.341242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2facd4f-9b4f-4a2a-bcd9-b46bd0992a2a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.343939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:12.380016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.380710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.380996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.381272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.382095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:12.382433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.383806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.396548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 623/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:12.402339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.413259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:12.511309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ec14-1cd8-42c0-af49-86f6c74fc1a9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.548155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.548782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.549059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.549328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.556604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.558112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:12.569983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:12.570986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:12.571874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:12.575994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 607/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:33:12.576942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.686778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c821b-6c0f-4fef-8371-49ee111e7661 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.724861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.725473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.725795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.726083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.726833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:12.727181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.728763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d727-1c01-473f-ba3f-83a29911cbda None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.742021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 624/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:12.748189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:12.824373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:12.864852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5733a-f402-43ad-b3ac-742132af303b None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:12.900731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:12.901392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:12.901673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:12.901945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/7e44512af18d47dcbd8f876b35dcb6d8/roles/b56e5f6a44a8466d8e4f18a3d10a1b96` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:12.916955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=7e44512af18d47dcbd8f876b35dcb6d8, role_id=b56e5f6a44a8466d8e4f18a3d10a1b96)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:12.918424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9686d-37fc-4088-b7b0-6861ef2a15e3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:12.930775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 608/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:33:12 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/7e44512af18d47dcbd8f876b35dcb6d8/roles/b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:33:15.065276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64d51d-feb2-4a47-b035-faa8ec85f77d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.065832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64d51d-feb2-4a47-b035-faa8ec85f77d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.065832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64d51d-feb2-4a47-b035-faa8ec85f77d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.067351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 625/1233] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:15.074656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.075121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.075409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.095377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:15.096534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:15.176584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 609/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:15.505571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64d51d-feb2-4a47-b035-faa8ec85f77d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:15.531991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:15.622112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64d51d-feb2-4a47-b035-faa8ec85f77d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:15.667817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:15.668451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.668729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.669004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.679416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:15.684033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:15.685123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:15.685997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 626/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Wed Aug 24 10:33:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:15.691661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:15.739390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:15.800226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb212d44-75d7-4a32-bb46-37ae99e2ea0e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:15.841424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:15.842110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:15.842429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:15.842674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:15.843895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:15.844193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:15.845564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:15.854486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 610/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Wed Aug 24 10:33:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:33:15.860582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:15.958045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:15.975832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fce38-2da1-489d-b4b0-bb3e45f2ffd4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:16.016835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:16.017624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:16.018294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:16.018570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:16.030723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.033579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:16.055187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:16.056490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:16.063199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:16.063199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:16.063199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:16.063199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 627/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:16.064152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:16.183533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f6550-1cdf-495b-a54f-6f1702751ab6 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:16.194166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:16.221769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:16.222620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:16.222901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:16.223248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:16.224090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:16.224434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.226238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.239983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 611/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:16.245807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:16.353448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996749e3-8d0c-4a83-af38-7940070c9299 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:16.389126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:16.389884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:16.390325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:16.390632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:16.393899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:16.400548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.402370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:16.415092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:16.416295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:16.417476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 628/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:33:16.422832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:16.527574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d6527-70ab-463b-847f-05e9a6a965b9 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:16.566173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:16.566877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:16.567229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:16.567540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:16.568369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:16.568714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.570236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.590156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 612/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:16.597627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:16.714510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6893b3-e41e-41bb-a2da-0a0955850897 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:16.756563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:16.757175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:16.757517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:16.757820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:16.832808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:16.845087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:16.846718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:16.960478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 629/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:33:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:33:16.961682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:16.989187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:17.075582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f634c6-9091-4e82-b430-4cb6a77d2a3d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:17.120396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:17.121279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:17.121590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:17.122003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:17.134539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:17.136171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:17.152600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:17.153804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:17.155137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:17.155137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:17.155137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:17.155137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 613/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 10:33:17.160065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:17.267594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:17.274843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212df6f-4e45-4abf-9b7a-d82a6029d114 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:17.313590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:17.314316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:17.314628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:17.315004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:17.315580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:17.315880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:17.317379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:17.330985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 630/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:17.336814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:17.429648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:17.455887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244ae6-0ee5-4bfd-80fc-2934dfea4327 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:17.493281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:17.493960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:17.494230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:17.494501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:17.502398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:17.503833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:17.516185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:17.517433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:17.518963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 614/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:17.523988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:17.631212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463dcba-73af-458f-81c9-a54767ad8bbc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:17.669104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:17.669712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:17.670096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:17.670496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:17.671175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:17.671577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:17.672999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe857f-fcc1-4af6-b883-23125f5088f5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:17.685457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 631/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:17.692416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:17.807243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fe69-9033-494f-8286-2873a77f2e14 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:17.853672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:17.854309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:17.854620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:17.854887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:17.855604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] RBAC: Adding query filter params (role.id=b56e5f6a44a8466d8e4f18a3d10a1b96, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=7e44512af18d47dcbd8f876b35dcb6d8) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:17.855982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:17.857530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30202be4-40e0-4f93-a952-6d75d2be9167 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:17.864906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 615/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:33:17 2022] GET /identity/v3/role_assignments?user.id=7e44512af18d47dcbd8f876b35dcb6d8&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=b56e5f6a44a8466d8e4f18a3d10a1b96 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:20.152671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046f05-2202-4749-b45d-e7725b843634 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:20.153207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046f05-2202-4749-b45d-e7725b843634 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:20.153207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae046f05-2202-4749-b45d-e7725b843634 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:20.154577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 632/1247] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:20.159739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:20.160219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:20.160399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:20.166671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:20.179860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:20.181074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:20.257396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 616/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:20.562903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046f05-2202-4749-b45d-e7725b843634 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:20.583034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:20.677118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae046f05-2202-4749-b45d-e7725b843634 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:20.712446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:20.713154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:20.713435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:20.713699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:20.725249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:20.730199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:20.734434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:20.735519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 633/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:33:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:20.738098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:20.847485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa874c3-07eb-4cd8-a443-480e3a33a54a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:20.878849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:20.884802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:20.885530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:20.885828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:20.886137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:20.886808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:20.887111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:20.888491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:20.898804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 617/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:33:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:33:20.905186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:20.994507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.020806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346c22-5c74-4ab6-8f79-7f77ee1ff1b6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.064474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.065552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.066015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.066325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.081406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.083011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:21.104629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:21.105791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:21.106836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:21.106836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:21.106836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:21.106836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 634/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:21.113404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:21.224922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22968c-21dd-446c-9882-815516da7bd4 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.262706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.263337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.263613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.263880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.264553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:21.265391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.266843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.280199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 618/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:21.286721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:21.393146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e351-b215-49bd-92f8-a88741f562b3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.421851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.429957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.430631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.430915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.431210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.439563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.441027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:21.452929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:21.454127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:21.455086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 635/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:21.460149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:21.521477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.567516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28d53a-a8c3-41ae-ab32-0e524c5425f3 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.604366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.604976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.605254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.605521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.606281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:21.606643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.608071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.625992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 619/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:21.631897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:21.737452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802427a1-b5f3-4193-887b-93c56cd42087 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:21.772523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:21.773136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:21.773418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:21.773692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:21.828856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:21.841270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:21.842764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:21.940647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 636/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:33:21.946469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:22.047712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c78054-bb12-48c7-962b-59cb651ba39f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:22.062915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:22.086384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:22.087013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:22.087297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:22.087594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:22.098241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:22.099699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:22.115791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:22.117002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:22.118123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:22.118123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:22.118123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:22.118123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 620/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:22.123060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:22.209304 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:22.221587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c1844-5942-4f86-9dad-e8bd1ac28f95 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:22.254146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:22.254745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:22.255027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:22.255301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:22.255944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:22.256252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:22.257608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:22.269222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 637/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:22.274897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:22.376751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbbb55-deff-4634-8942-d7b25fd0ae7a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:22.410382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:22.411003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:22.411277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:22.411544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:22.417936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:22.419403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:22.430741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:22.431807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:22.432938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 621/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:22.438378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:22.533076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e268617-ffde-46b1-b051-2a1810b4fcd7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:22.564641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:22.565215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:22.565492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:22.565756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:22.566465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:22.566769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:22.568161 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ecce-6de9-46a4-bdc2-b05f42b2653c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:22.580101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 638/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:22.586190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:22.612449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:22.688199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929115a2-fd6e-47d7-a91a-29cc96d71b0e None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:22.721208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:22.721806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:22.722098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:22.722378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:22.723089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=7e44512af18d47dcbd8f876b35dcb6d8) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:22.723395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:22.724819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4238c4-7844-4213-a901-8aaa15f78254 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:22.734106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 622/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:33:22 2022] GET /identity/v3/role_assignments?user.id=7e44512af18d47dcbd8f876b35dcb6d8&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:24.599193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac028f-5fe6-4929-99f5-0aa0e77c5dc5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.599721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac028f-5fe6-4929-99f5-0aa0e77c5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.599721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac028f-5fe6-4929-99f5-0aa0e77c5dc5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.601066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 639/1261] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:24.606117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:24.606561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:24.606677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:24.624821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:24.626012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:24.691846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 623/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:24.956949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac028f-5fe6-4929-99f5-0aa0e77c5dc5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:24.967664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.061308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac028f-5fe6-4929-99f5-0aa0e77c5dc5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.100802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.101532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.102010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.102499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.113183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:25.117813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:25.118952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:25.119997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 640/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:25.125051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.143288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.221594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a89db-bfaa-4d8e-b7b0-c10905de6ef1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.254118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.254712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.254985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.255253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.255903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:25.256201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.257560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.265292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 624/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:25.271218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.338898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.371840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee332d-6255-4553-a7b9-c78229b8c94a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.403351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.403973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.404251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.404520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.414959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.416379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:25.429742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:25.430974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:25.432089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:25.432089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:25.432089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:25.432089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 641/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:25.436817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.516971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.536939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47fa12-2b72-4d64-ab91-0f6f44ec6353 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.570015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.570654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.570932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.571201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.571834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:25.572134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.573524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.585430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 625/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:25.591237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.690019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d907322-c499-4f1a-8d08-e4f47aad2e73 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.709288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.723512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.724138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.724433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.724699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.731948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.733906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:25.744732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:25.746046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:25.747594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 642/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:25.752233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:25.849575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd1891-35ad-42db-9ac0-0b48d77d2d95 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:25.884881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:25.885490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:25.885763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:25.886031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:25.886791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:25.887091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:25.888519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:25.897922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:25.907281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 626/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:25.913476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.010832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969758-3425-46f1-b84e-3a72a8cfacf4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:26.047571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:26.048295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.048573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.048885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.060141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:26.062293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:26.075891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:26.077027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:26.078879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:26.078879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:26.078879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:26.078879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 643/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:26.083503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.184154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95ddd-c141-485f-a489-4511cefe468d None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:26.217302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:26.217895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.218197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.218465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.219094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:26.219389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:26.220742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:26.231572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 627/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:26.237670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.269650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:26.337643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104bca1-47e4-4b26-8f7b-3d5439a512a5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:26.373266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:26.373878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.374751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.375023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.381335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:26.382776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:26.393950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:26.394987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:26.395948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 644/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:26.401177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.457471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:26.498670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed074e-52e4-4473-bd83-000e2aef3897 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:26.532785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:26.533367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.533644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.533906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.534667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:26.535019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:26.536562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb97dd-14f0-48ea-99e8-82279202630f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:26.550623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 628/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:26.556449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:26.645032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:26.653738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd5b94-fd44-498c-be65-4ad88aee8107 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:26.686205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:26.687340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:26.687612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:26.687881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] PATH_INFO: `/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/7e44512af18d47dcbd8f876b35dcb6d8/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:26.689725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da9eea19cea458a839d63b3b31ba1d0, user_id=7e44512af18d47dcbd8f876b35dcb6d8, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:26.691204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca9669-c9c0-41aa-a8c3-382f2851e7f7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:26.703788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 645/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Wed Aug 24 10:33:26 2022] PUT /identity/v3/projects/1da9eea19cea458a839d63b3b31ba1d0/users/7e44512af18d47dcbd8f876b35dcb6d8/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:33:28.608871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c85d-4320-40cc-8923-8ec5abe2e8a6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:28.609399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c85d-4320-40cc-8923-8ec5abe2e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:28.609399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c85d-4320-40cc-8923-8ec5abe2e8a6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:28.610789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 629/1274] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:28.616004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:28.616393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:28.616556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:28.634912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:28.636199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:28.700341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 646/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:28.980050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c85d-4320-40cc-8923-8ec5abe2e8a6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.087925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c85d-4320-40cc-8923-8ec5abe2e8a6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.106859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:29.124644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.125340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.125654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.125920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.136847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 10:33:29.143170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:29.144259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:29.145358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 630/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Wed Aug 24 10:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:29.150897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.229542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:29.248322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e8ee-c4cd-438e-a348-6f33994f2504 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.280784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.281386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.281663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.281935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.282621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:29.282922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:29.284271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:29.291928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 647/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:29.298174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.407362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9cee4-708e-4787-ab42-bf1029bfd2fc None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.443507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.444122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.444401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.444673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.454502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:29.455943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:29.470213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:29.471325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:29.472397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:29.472397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:29.472397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:29.472397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 631/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:29.477277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.573899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83b6-de86-465c-88e1-fcf6b2d4d062 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.605654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.606275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.606564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.606838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.607475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:29.607778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:29.609700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:29.621159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 648/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:29.627160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.657558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:29.725102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b15267-c485-4670-8342-b6af75bef54c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.757775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.758426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.758709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.758979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.766688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:29.768396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 10:33:29.779497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:29.781172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:29.782506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 632/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:29.787081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:29.790883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:29.890311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb28d8b-1a3b-4106-b25b-32f2204cda97 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:29.924543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:29.925144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:29.925426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:29.925699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:29.926448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:29.926755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:29.928171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:29.945123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 649/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:29.951007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.042896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.052503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78753-2ef6-421d-bf5f-ff8ae9c3fc8c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.085181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.085769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.086040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.086333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.151167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:30.152608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:30.237617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.248083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 633/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Wed Aug 24 10:33:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 10:33:30.254106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.315491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.353220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad186d7-bc0b-4148-8761-0645812e1b74 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.385628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.386273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.386551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.386819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.397592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:30.399061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 10:33:30.413080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:30.414202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 10:33:30.415113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 10:33:30.415113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 10:33:30.415113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:30.415113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 650/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:30.420137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.518959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915c020-7a0f-4286-ab20-d72cb3c5e39c None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.551240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.551840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.552113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.552379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.553003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:30.553303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:30.554710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:30.566290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 634/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:30.572021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.677672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6da12-5ef7-43ad-86e9-88991b771275 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.692080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.712432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.713064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.713340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.713609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.721039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:30.722602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 10:33:30.734346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:30.735391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 24 10:33:30.736674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 651/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:30.741306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.790244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:30.839423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f260a7-63b3-4e0a-8ed1-add44fa35913 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:30.876803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:30.877398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:30.877674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:30.877943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:30.878654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:30.878958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:30.880377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d53909-3176-4f80-bb8b-9fa2847e44b3 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:30.892160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 635/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:30.898680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:30.995574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae66f9-5292-4816-ac30-59e92e282cb7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:31.028197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:31.028853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:31.029135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:31.029405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:31.030764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] RBAC: Adding query filter params (role.id=88421fc218124abeb809266ecb9668ea, scope.project.id=1da9eea19cea458a839d63b3b31ba1d0, user.id=7e44512af18d47dcbd8f876b35dcb6d8) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:31.031071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:31.032502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e90f8-fa0c-4d55-ab2d-cd132b0967c2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:31.038558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 652/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Wed Aug 24 10:33:30 2022] GET /identity/v3/role_assignments?user.id=7e44512af18d47dcbd8f876b35dcb6d8&scope.project.id=1da9eea19cea458a839d63b3b31ba1d0&role.id=88421fc218124abeb809266ecb9668ea => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:32.927316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c7ec-f175-4e19-a752-fb6018590155 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:32.927825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c7ec-f175-4e19-a752-fb6018590155 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:32.927912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c7ec-f175-4e19-a752-fb6018590155 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:32.929205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 636/1288] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:32.934422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:32.934831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:32.934978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:32.953019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:32.954245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:32.983217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.019611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 653/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:33.294576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c7ec-f175-4e19-a752-fb6018590155 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:33.398716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c7ec-f175-4e19-a752-fb6018590155 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:33.409528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:33.432895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:33.433517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:33.433792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:33.434081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:33.434661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:33.436017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:33.445463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:33.446716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:33.447781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 637/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:33:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:33.453428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:33.552796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5fc6-a0f0-481d-8413-662a19f109f4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:33.587193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:33.587793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:33.588074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:33.588500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:33.589033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:33.589334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:33.590722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f5910-2be9-475a-89ec-bbef3d6f9160 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:33.595522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 654/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 24 10:33:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:33.601280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:33.699690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559e01a-907a-49c5-814d-ed152b033a7f None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:33.731479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:33.732065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:33.732337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:33.732601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] PATH_INFO: `/v3/services` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:33.733714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:33.734009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:33.735391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ba921-cb8b-4c87-8cc4-f0c605d63223 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:33.739624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 638/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 24 10:33:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:35.631533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83eba8-686a-4d59-958b-1384ee1d9ba9 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:35.632086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83eba8-686a-4d59-958b-1384ee1d9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:35.632086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83eba8-686a-4d59-958b-1384ee1d9ba9 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:35.633438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 655/1293] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:35.638690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907df-28cd-4065-bb04-92424a1160e8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:35.639141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907df-28cd-4065-bb04-92424a1160e8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:35.639859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193907df-28cd-4065-bb04-92424a1160e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:35.657735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-193907df-28cd-4065-bb04-92424a1160e8 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:35.658955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-193907df-28cd-4065-bb04-92424a1160e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:35.687913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:35.727062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 639/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:35.994584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83eba8-686a-4d59-958b-1384ee1d9ba9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:36.025523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:36.108984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83eba8-686a-4d59-958b-1384ee1d9ba9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:36.141623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:36.142497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:36.142776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:36.143043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:36.143686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:36.145045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce02b5-3807-405e-80cc-5f9411a39031 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:36.159595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 656/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Wed Aug 24 10:33:35 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:33:38.026637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839360-219d-4773-80c8-04074b3d3756 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.027191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839360-219d-4773-80c8-04074b3d3756 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.027191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4839360-219d-4773-80c8-04074b3d3756 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.028786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 640/1296] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:38.034326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.034846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.034936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.052328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:38.053508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:38.122758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 657/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:38.384430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839360-219d-4773-80c8-04074b3d3756 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:38.485090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4839360-219d-4773-80c8-04074b3d3756 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:38.518474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:38.519103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.519381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.519651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.520230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:38.521596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:38.530880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:38.532024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:38.533199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 641/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:33:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:38.538014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:38.555683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:38.635847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332738-c568-4832-bf8c-b468cf6b78a4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:38.668875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:38.669478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.669758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.670028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.670691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:38.670991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:38.672351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:38.677306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 658/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 24 10:33:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:38.683346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:38.715492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:38.783650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f5892-3af2-457d-9d0d-c6e5bd3ec3b7 None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:38.815950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:38.816541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.816813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.817079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.817765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] RBAC: Adding query filter params (interface=public, service_id=d953a9e079094ddfa2186a5bd2e50da3, region_id=RegionOne) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:38.818092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:38.819443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03d3d-3250-40aa-aead-ac3aafb2627d None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:38.824300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 642/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Wed Aug 24 10:33:38 2022] GET /identity/v3/endpoints?service_id=d953a9e079094ddfa2186a5bd2e50da3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:38.830635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:38.909608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:38.927652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ca4e0-00f7-4993-906f-590967b2c231 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:38.960201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:38.960802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:38.961080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:38.961354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:38.961964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:38.963350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301002f7-b49c-40d5-acf8-9f2c9963cb99 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:38.969993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 659/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Wed Aug 24 10:33:38 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:33:40.822338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d87a9-eba4-4b4e-952e-4e5a3cd3530d None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:40.822867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d87a9-eba4-4b4e-952e-4e5a3cd3530d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:40.822867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d87a9-eba4-4b4e-952e-4e5a3cd3530d None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:40.824232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 643/1302] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:33:40.829955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:40.830379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:40.830528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:40.848355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:33:40.849546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:33:40.914432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 660/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:33:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 10:33:41.185737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d87a9-eba4-4b4e-952e-4e5a3cd3530d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:41.278338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:41.285059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d87a9-eba4-4b4e-952e-4e5a3cd3530d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:41.318034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:41.318677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:41.318955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:41.319228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:41.319803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:41.321152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 10:33:41.329706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 10:33:41.330894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application with Lock( Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self._enter() Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application return self.creator() Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application created_value = creator( Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: ERROR keystone.server.flask.application Aug 24 10:33:41.331904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 644/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Wed Aug 24 10:33:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 10:33:41.336772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:41.409601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:41.431938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc655629-a85a-4926-9dc7-b6a7172102e1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:41.473403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:41.473937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:41.474248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:41.474521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:41.475151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:33:41.475457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:41.476821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dad24f-42a0-4ab1-a56a-2bb7655157fe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:41.481877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 661/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Wed Aug 24 10:33:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:33:41.487677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:33:41.586681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2677a5-769f-4d9e-896f-d078c227f61a None admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:33:41.619980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:33:41.620576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:33:41.620847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:33:41.621111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:33:41.621768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:33:41.624498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4d367-2394-4686-875b-85705e61320b None admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:33:41.643189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 645/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:33:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:33:51.478915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=30 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:33:51.638915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:45.970090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275cb-caa1-4d25-af92-7742528abeac None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:45.971378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275cb-caa1-4d25-af92-7742528abeac None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:45.971942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275cb-caa1-4d25-af92-7742528abeac None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:45.978557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 662/1307] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:34:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:45.980301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75eed-e704-40cc-974f-5526fa89e9bb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:45.980690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75eed-e704-40cc-974f-5526fa89e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:45.980908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75eed-e704-40cc-974f-5526fa89e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:46.117890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1ab75eed-e704-40cc-974f-5526fa89e9bb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:46.120570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1ab75eed-e704-40cc-974f-5526fa89e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:46.278123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 646/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:34:46.575757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:46.576044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:46.576622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:46.577960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 663/1309] 10.222.0.52 () {54 vars in 965 bytes} [Wed Aug 24 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:46.584923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d60f-d243-44c7-87f6-289349bd163d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:46.585363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d60f-d243-44c7-87f6-289349bd163d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:46.585710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9d60f-d243-44c7-87f6-289349bd163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:46.665017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-23c9d60f-d243-44c7-87f6-289349bd163d None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:46.666398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-23c9d60f-d243-44c7-87f6-289349bd163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:46.691512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:46.757833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 647/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Wed Aug 24 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:46.768154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:46.769891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:46.902753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9df89c-e943-40cc-bbdd-5b82abb11a94 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:46.979841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:46.980506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:46.980773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:46.981003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:46.982662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:47.044933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:47.103015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:47.104328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a976fc-d4ab-4163-8681-f34e73d91b9f service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:47.123160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 664/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:49.312617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:49.313158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:49.313158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:49.315257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 648/1312] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:49.320316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a935b-fa08-40c8-9378-7d0051dfc125 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:49.320709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a935b-fa08-40c8-9378-7d0051dfc125 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:49.320891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a935b-fa08-40c8-9378-7d0051dfc125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:49.405813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cf1a935b-fa08-40c8-9378-7d0051dfc125 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:49.407187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cf1a935b-fa08-40c8-9378-7d0051dfc125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:49.521158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 665/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:49.812282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:49.814530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:49.924626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e796-5bdc-41f0-9882-919f2b830ee6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:49.999850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:50.003071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:50.003856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:50.004291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:50.004754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:50.006440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:50.124381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:50.125783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18666742-0ce7-48b7-931d-05d40e121abc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:50.146598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 649/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:34:52.370216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:52.370791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:52.370791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:52.372127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 666/1315] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:52.377742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430f67-a5f1-41eb-978e-378352de6e36 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:52.378189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430f67-a5f1-41eb-978e-378352de6e36 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:52.378301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52430f67-a5f1-41eb-978e-378352de6e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:52.446373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-52430f67-a5f1-41eb-978e-378352de6e36 None None] MFA Rules not processed for user `397a24e018744894addac09d82911043`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:52.447578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-52430f67-a5f1-41eb-978e-378352de6e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:52.497876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:52.542498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 650/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:52.825964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:52.827533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:52.837860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:52.930374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02dc0c-0226-4d8a-80fb-3dd565b58698 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:53.001329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:53.001929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:53.002238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:53.002512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:53.004103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:53.064641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:53.111746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:53.113140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99512c-b003-4f8a-bf2c-ac8a8a472fb6 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:53.131550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 667/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:55.541112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.541589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.541689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.543070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 651/1318] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:55.548109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0552-8f6d-4f7f-a23c-cee3104fe30d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:55.548542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0552-8f6d-4f7f-a23c-cee3104fe30d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:55.548664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0552-8f6d-4f7f-a23c-cee3104fe30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:55.613041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-650c0552-8f6d-4f7f-a23c-cee3104fe30d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:55.614254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-650c0552-8f6d-4f7f-a23c-cee3104fe30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:55.709631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 668/1319] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:55.998481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:56.000071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:56.106805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb67cd9-c829-4829-bd05-a8903ff4b744 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:56.178623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:56.179242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:56.179516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:56.179783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:56.181380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:56.189621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:56.291384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:56.292829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d69ee-49c5-4d45-a13a-972e10c101d6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:56.311621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 652/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:34:58.899984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3150-8417-4c99-aaa8-6aac3d6c1c65 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:58.900533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3150-8417-4c99-aaa8-6aac3d6c1c65 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:58.900627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3150-8417-4c99-aaa8-6aac3d6c1c65 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:58.901985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 669/1321] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:58.907952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e63e-fd9f-471c-8f0c-218a8f321682 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:58.908347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e63e-fd9f-471c-8f0c-218a8f321682 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:58.908634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2e63e-fd9f-471c-8f0c-218a8f321682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:58.974049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-88c2e63e-fd9f-471c-8f0c-218a8f321682 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:58.975278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-88c2e63e-fd9f-471c-8f0c-218a8f321682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:59.032685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:59.074283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 653/1322] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:34:59.377108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:59.377480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:59.377823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:59.379291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 670/1323] 10.222.0.52 () {54 vars in 965 bytes} [Wed Aug 24 10:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:34:59.385427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cdc9a-5906-4c2d-b400-aed54cdfcaec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:59.385782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cdc9a-5906-4c2d-b400-aed54cdfcaec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:59.386159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7cdc9a-5906-4c2d-b400-aed54cdfcaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:59.461857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ad7cdc9a-5906-4c2d-b400-aed54cdfcaec None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:34:59.463105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ad7cdc9a-5906-4c2d-b400-aed54cdfcaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:59.541416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 654/1324] 10.222.0.52 () {58 vars in 1062 bytes} [Wed Aug 24 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:34:59.551420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:34:59.552956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:59.573289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:59.659127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b156f-b0c7-4d98-b5a9-ae06a1199c9c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:34:59.731287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:34:59.731900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:34:59.732180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:34:59.732455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:34:59.734043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:34:59.804977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:34:59.843324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:34:59.845428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d00a-bca1-4e9d-bbc2-160d1a4d4cec service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:34:59.863916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 671/1325] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:02.010345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:02.010893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:02.010893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:02.012252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 655/1326] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:02.018490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eff5-d225-408a-b98a-a6fcfad6176b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:02.018887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eff5-d225-408a-b98a-a6fcfad6176b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:02.019164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eff5-d225-408a-b98a-a6fcfad6176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:02.091403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d605eff5-d225-408a-b98a-a6fcfad6176b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:02.092548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d605eff5-d225-408a-b98a-a6fcfad6176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:02.194215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 672/1327] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:02.475643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:02.477228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:02.541523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:02.585333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442ca59-ad1d-4494-9297-77d2d35a53b0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:02.660343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:02.660947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:02.661225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:02.661494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:02.663129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:02.770407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:02.773541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:02.775120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3ec9-0732-4207-a906-97f0bf92affb service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:02.793679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 656/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:04.726448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:04.729204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:04.729204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:04.729204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 673/1329] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:04.733521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44031f-3bc3-493f-8f0a-15895f043785 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:04.733965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44031f-3bc3-493f-8f0a-15895f043785 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:04.734160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44031f-3bc3-493f-8f0a-15895f043785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:04.801157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ef44031f-3bc3-493f-8f0a-15895f043785 None None] MFA Rules not processed for user `397a24e018744894addac09d82911043`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:04.802515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef44031f-3bc3-493f-8f0a-15895f043785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:04.917536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 657/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:05.199988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:05.201457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:05.231951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:05.302916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f98a-868f-4676-9f1d-821f616ec384 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:05.374374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:05.375496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:05.375831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:05.376098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:05.377662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:05.457002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:05.490287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:05.491744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41adf74-25fb-4c55-90c0-6a7af4fe1f2b service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:05.510937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 674/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:07.874025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:07.874549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:07.874646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:07.876014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 658/1332] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:07.881292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006033-4b4d-4e5e-b992-35a88cdab56e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:07.881743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006033-4b4d-4e5e-b992-35a88cdab56e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:07.881850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006033-4b4d-4e5e-b992-35a88cdab56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:07.947325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c0006033-4b4d-4e5e-b992-35a88cdab56e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:07.948511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0006033-4b4d-4e5e-b992-35a88cdab56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:08.047853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 675/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:35:08.339408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:08.340993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:08.414551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:08.449524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72392aff-ad65-473c-a47d-a607eb8e9b10 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:08.530596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:08.531758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:08.532034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:08.532301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:08.533907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:08.640287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:08.642232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd98c4a-cfab-46dc-8763-fedafe891744 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:08.651915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:08.660983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 659/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:10.573227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:10.573789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:10.573789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:10.575172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 676/1335] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:10.580335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532b87-7426-450b-a8b6-94fbe9b50555 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:10.580735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532b87-7426-450b-a8b6-94fbe9b50555 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:10.580865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8532b87-7426-450b-a8b6-94fbe9b50555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:10.646300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d8532b87-7426-450b-a8b6-94fbe9b50555 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:10.647515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d8532b87-7426-450b-a8b6-94fbe9b50555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:10.741539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 660/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:11.024629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:11.026212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:11.066075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:11.128165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0aaa61-3160-4448-aa31-2b47ee3bd604 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:11.199494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:11.200100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:11.200378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:11.200646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:11.202254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:11.286251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:11.311818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:11.313787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ff2c-f9cf-4eb9-8dfb-bc03f5079298 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:11.332327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 677/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:13.648357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:13.648883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:13.648883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:13.650292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 661/1338] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:13.655269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59586de4-7e21-46b2-8f05-57d24a5d5488 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:13.655693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59586de4-7e21-46b2-8f05-57d24a5d5488 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:13.656324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59586de4-7e21-46b2-8f05-57d24a5d5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:13.721437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-59586de4-7e21-46b2-8f05-57d24a5d5488 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:13.722685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-59586de4-7e21-46b2-8f05-57d24a5d5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:13.816051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 678/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:14.096523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:14.098062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:14.174077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:14.201865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0184d-06f2-4c50-92c4-3ff65b09bd35 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:14.273504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:14.274166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:14.274444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:14.274710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:14.276348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:14.385398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:14.386783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615d44-1aa8-457a-a49e-d899fa2d1d04 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:14.404815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 662/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:18.303808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87567b-2924-4073-bf88-6be91449442b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:18.304326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87567b-2924-4073-bf88-6be91449442b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:18.304420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87567b-2924-4073-bf88-6be91449442b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:18.305739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 679/1341] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:18.311253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a44fd-13bc-4f07-967e-5c2e203291f8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:18.311661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a44fd-13bc-4f07-967e-5c2e203291f8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:18.311787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a44fd-13bc-4f07-967e-5c2e203291f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:18.317345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:18.379628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1b5a44fd-13bc-4f07-967e-5c2e203291f8 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:18.380830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1b5a44fd-13bc-4f07-967e-5c2e203291f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:18.479937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 663/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:18.767661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87567b-2924-4073-bf88-6be91449442b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:18.769209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6e87567b-2924-4073-bf88-6be91449442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:18.818471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:18.877197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87567b-2924-4073-bf88-6be91449442b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:18.952986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:18.953597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:18.953870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:18.954174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:18.955758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:19.052155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:19.068791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:19.070255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6509eb-579e-4f4b-9516-fcd59ba46084 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:19.088205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 680/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:21.613898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:21.614524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:21.614524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:21.615825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 664/1344] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:21.621039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7707f4-a833-4488-a9e3-b407923f9e42 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:21.621480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7707f4-a833-4488-a9e3-b407923f9e42 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:21.621591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7707f4-a833-4488-a9e3-b407923f9e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:21.689773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9b7707f4-a833-4488-a9e3-b407923f9e42 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:21.690997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9b7707f4-a833-4488-a9e3-b407923f9e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:21.785572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 681/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:22.067002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:22.068675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:22.156299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:22.174135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db583753-694c-4658-8a8b-113b58ec1261 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:22.251141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:22.251764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:22.252041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:22.252312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:22.253987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:22.363773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:22.365211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28af2b-7515-4fdb-8a2c-7501cb825c98 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:22.383304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 665/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:35:26.559933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:26.560481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:26.560481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:26.561890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 682/1347] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:26.567498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83625d-bad5-4006-86b3-e1165906d05b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:26.567962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83625d-bad5-4006-86b3-e1165906d05b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:26.568196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83625d-bad5-4006-86b3-e1165906d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:26.584341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:26.641439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8b83625d-bad5-4006-86b3-e1165906d05b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:26.642691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8b83625d-bad5-4006-86b3-e1165906d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:26.755301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 666/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:27.035162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:27.036682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:27.093629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:27.137669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0f59-073a-46d5-b047-9b09a94e43a6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:27.210239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:27.210842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:27.211118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:27.211388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:27.212951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:27.314821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:27.318286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:27.320030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d349ffa-48ea-45c9-adc5-818d40b9c3a5 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:27.338905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 683/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:32.293112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2744ea-f355-4f77-a014-ff88d4fdef69 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:32.293547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2744ea-f355-4f77-a014-ff88d4fdef69 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:32.293649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2744ea-f355-4f77-a014-ff88d4fdef69 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:32.295972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 667/1350] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:32.301037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940101e1-cb90-4d38-a441-6fab79308d5a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:32.301462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940101e1-cb90-4d38-a441-6fab79308d5a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:32.301699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940101e1-cb90-4d38-a441-6fab79308d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:32.409838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-940101e1-cb90-4d38-a441-6fab79308d5a None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:32.411090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-940101e1-cb90-4d38-a441-6fab79308d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:32.577776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 684/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:36.738442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ada1-ae2f-43c4-9236-b4faaf9ee455 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:36.739385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ada1-ae2f-43c4-9236-b4faaf9ee455 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:36.739771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ada1-ae2f-43c4-9236-b4faaf9ee455 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:36.741195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 668/1352] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:36.746430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091762d-a7ae-479d-9e92-827add8c3d6b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:36.746852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091762d-a7ae-479d-9e92-827add8c3d6b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:36.746973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091762d-a7ae-479d-9e92-827add8c3d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:36.753292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=59 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:36.808514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:36.837124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0091762d-a7ae-479d-9e92-827add8c3d6b None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:36.839358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0091762d-a7ae-479d-9e92-827add8c3d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:36.964757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 685/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:38.643729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a466c2-8848-4bad-bf44-d823eb32f220 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:38.644278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a466c2-8848-4bad-bf44-d823eb32f220 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:38.644278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a466c2-8848-4bad-bf44-d823eb32f220 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:38.645713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 669/1354] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:38.651230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223b619-81c4-400b-9c51-a53c79437f77 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:38.651652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223b619-81c4-400b-9c51-a53c79437f77 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:38.651781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223b619-81c4-400b-9c51-a53c79437f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:38.729003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2223b619-81c4-400b-9c51-a53c79437f77 None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:38.730261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2223b619-81c4-400b-9c51-a53c79437f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:38.772284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:38.841004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 686/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:35:42.522137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb625a-ce7f-4ed7-a6be-c1be60a96256 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:42.522720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb625a-ce7f-4ed7-a6be-c1be60a96256 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:42.522720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb625a-ce7f-4ed7-a6be-c1be60a96256 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:42.524016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 670/1356] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:42.530710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062d0c-3e1f-405b-8bc0-8fe4ba445511 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:42.531678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062d0c-3e1f-405b-8bc0-8fe4ba445511 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:42.531961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f062d0c-3e1f-405b-8bc0-8fe4ba445511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:42.604359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0f062d0c-3e1f-405b-8bc0-8fe4ba445511 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:42.605581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f062d0c-3e1f-405b-8bc0-8fe4ba445511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:42.724242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 687/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:43.031584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:43.031792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:43.032325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:43.033766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 671/1358] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 24 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:43.043330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fad4-2500-4b5e-8a97-92d94517224c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:43.043802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fad4-2500-4b5e-8a97-92d94517224c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:43.044240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3fad4-2500-4b5e-8a97-92d94517224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:43.069632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:43.133536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cba3fad4-2500-4b5e-8a97-92d94517224c None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:43.134915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cba3fad4-2500-4b5e-8a97-92d94517224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:43.261167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 688/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 24 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:43.269361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:43.270927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:43.425701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b8dff-3877-4a4c-af33-1a211daf9cd6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:43.504450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:43.548497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:43.549202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:43.549467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:43.549673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:43.551405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:43.654003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:43.655625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520f80f-9af6-4e0c-bacf-41d97ddfbc88 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:43.676712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 672/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:45.811492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:45.812012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:45.812093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:45.813670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 689/1361] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:45.819235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac9b9-88ed-4444-9bbe-040bd76caebc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:45.819658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac9b9-88ed-4444-9bbe-040bd76caebc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:45.819782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ac9b9-88ed-4444-9bbe-040bd76caebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:45.907320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-309ac9b9-88ed-4444-9bbe-040bd76caebc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:45.908731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-309ac9b9-88ed-4444-9bbe-040bd76caebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:45.957090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:46.038405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 673/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:46.320845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:46.322598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:46.392997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:46.490438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193bb39-59aa-42a5-aeb3-f589ddf0f4ac None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:46.637224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:46.638830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:46.639275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:46.639755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:46.641896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:46.674704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:46.767114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:46.770478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6292ee-5c4f-4e0a-94de-455fe0e68ae6 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:46.804401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 690/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:49.047894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5c8-7677-44e4-a2ed-9d8f0e3871dd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:49.048430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5c8-7677-44e4-a2ed-9d8f0e3871dd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:49.048430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5c8-7677-44e4-a2ed-9d8f0e3871dd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:49.050130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 674/1364] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:49.055640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9708ac-53b9-4144-a9d0-736c56a4427a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:49.056082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9708ac-53b9-4144-a9d0-736c56a4427a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:49.056181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9708ac-53b9-4144-a9d0-736c56a4427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:49.135326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2f9708ac-53b9-4144-a9d0-736c56a4427a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:49.136844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2f9708ac-53b9-4144-a9d0-736c56a4427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:49.241751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:49.254087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 691/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:49.538802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4768-0951-491c-b637-a1681516eaac None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:49.539096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4768-0951-491c-b637-a1681516eaac None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:49.539360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de4768-0951-491c-b637-a1681516eaac None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:49.540845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 675/1366] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 24 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:49.547100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b250df4-581f-4b23-8757-95ba7d5388c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:49.547780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b250df4-581f-4b23-8757-95ba7d5388c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:49.548156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b250df4-581f-4b23-8757-95ba7d5388c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:49.639006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5b250df4-581f-4b23-8757-95ba7d5388c2 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:49.640450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5b250df4-581f-4b23-8757-95ba7d5388c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:49.768016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 692/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 24 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:49.776303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de4768-0951-491c-b637-a1681516eaac None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:49.777860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1de4768-0951-491c-b637-a1681516eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:49.944927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de4768-0951-491c-b637-a1681516eaac None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:49.967912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:50.066795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:50.067635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:50.068010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:50.068379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:50.070248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:50.163680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:50.165387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfc095-88f1-4700-88e0-89e8919966e8 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:50.185226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 676/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:50.472174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59992c-3f0c-45b9-885a-f62f723d64d6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:50.472716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59992c-3f0c-45b9-885a-f62f723d64d6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:50.472716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59992c-3f0c-45b9-885a-f62f723d64d6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:50.476885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 693/1369] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:50.479878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c20-6269-46ed-9897-dacbd17fefd4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:50.480162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c20-6269-46ed-9897-dacbd17fefd4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:50.480434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f4c20-6269-46ed-9897-dacbd17fefd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:50.514269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:50.554595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d15f4c20-6269-46ed-9897-dacbd17fefd4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:50.555856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d15f4c20-6269-46ed-9897-dacbd17fefd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:50.661446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 677/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:51.260153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:51.260435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:51.260706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:51.263963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 694/1371] 10.222.0.52 () {54 vars in 964 bytes} [Wed Aug 24 10:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:51.268056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd30a9-b36e-4d5f-8a5a-00299ba61a48 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:51.268533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd30a9-b36e-4d5f-8a5a-00299ba61a48 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:51.268622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd30a9-b36e-4d5f-8a5a-00299ba61a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:51.363865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7ffd30a9-b36e-4d5f-8a5a-00299ba61a48 None None] MFA Rules not processed for user `273e5c26e347484d84b6b1b196b11282`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:51.365104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ffd30a9-b36e-4d5f-8a5a-00299ba61a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:51.417985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:51.451513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 678/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Wed Aug 24 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:51.459237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:51.460782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:51.515722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:51.573479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddfa62-0954-4ca3-84e4-0f30dd93fe86 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:51.671824 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:51.672407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:51.672705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:51.672980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:51.674551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:51.782847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:51.799519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:51.801819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10136d81-d6dc-4531-b79e-2c0fe97a1989 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:51.822368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 695/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:35:52.212459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:52.212745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:52.213020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:52.214448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 679/1374] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:52.220453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8279-3b22-4e44-bc85-e76d14394ecf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:52.220743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8279-3b22-4e44-bc85-e76d14394ecf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:52.221024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d8279-3b22-4e44-bc85-e76d14394ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:52.290475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c63d8279-3b22-4e44-bc85-e76d14394ecf None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:52.291710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c63d8279-3b22-4e44-bc85-e76d14394ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:52.390708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 696/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:52.682538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:52.684274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:52.839865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71503f-9e93-41f8-a871-280cb325a3e1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:52.892514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:52.953792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:52.954428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:52.954706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:52.954975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:52.956583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:53.049732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:53.051369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f073c-17e3-415b-9f48-431fa3726d9f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:53.070346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 680/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:35:55.020234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:55.020720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:55.020720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:55.022086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 697/1377] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:55.027571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586437-8606-4cce-8922-6c7e6a8873a9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:55.027977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586437-8606-4cce-8922-6c7e6a8873a9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:55.028113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586437-8606-4cce-8922-6c7e6a8873a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:55.105843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-da586437-8606-4cce-8922-6c7e6a8873a9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:55.107651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-da586437-8606-4cce-8922-6c7e6a8873a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:55.114502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:55.206202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 681/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:55.495119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:55.496633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:55.561758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:55.657066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019aa46-fc33-441c-83f4-a6535d41ff33 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:55.777753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:55.778834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:55.779118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:55.779392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:55.780997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:55.801918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:55.884631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:55.886703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1167456-29b3-487d-bd2a-75a1035c26a1 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:55.906786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 698/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:35:57.862981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:57.863517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:57.863517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:57.865026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 682/1380] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:35:57.870124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c181b0-782a-4828-bdb3-bc506e3783fb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:57.870526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c181b0-782a-4828-bdb3-bc506e3783fb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:57.870736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c181b0-782a-4828-bdb3-bc506e3783fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:57.942325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-51c181b0-782a-4828-bdb3-bc506e3783fb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:35:57.943665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-51c181b0-782a-4828-bdb3-bc506e3783fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:58.041006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:58.050627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 699/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:35:58.341481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:35:58.343271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:58.492163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:58.504785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09f9e1-7312-4c5c-b0a9-ae3ff9ac5148 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:35:58.625322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:35:58.626014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:35:58.626429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:35:58.626809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:35:58.628574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:35:58.728960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:35:58.730779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875cedd6-a67b-483d-8612-a25ef100f9f0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:35:58.741961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:35:58.752323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 683/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:00.920836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:00.921420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:00.921420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:00.923135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 700/1383] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:00.929007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8766-0806-49cc-aa3d-a9b3ac7e9219 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:00.929492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8766-0806-49cc-aa3d-a9b3ac7e9219 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:00.929593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8766-0806-49cc-aa3d-a9b3ac7e9219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:01.003294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cf3d8766-0806-49cc-aa3d-a9b3ac7e9219 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:01.004861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cf3d8766-0806-49cc-aa3d-a9b3ac7e9219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:01.110465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 684/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:01.407925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:01.410208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:01.581001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597f7b7-88cc-4281-8273-29baffe9e62f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:01.655502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:01.705146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:01.705781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:01.706095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:01.706371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:01.708054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:01.803654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:01.805312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8c68e-676a-4a10-babf-2cc031d818db service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:01.824508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 701/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:03.763127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:03.763691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:03.763691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:03.765354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 685/1386] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:03.771122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120347f-8683-4141-b53b-4fa2f8cad181 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:03.771612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120347f-8683-4141-b53b-4fa2f8cad181 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:03.771730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120347f-8683-4141-b53b-4fa2f8cad181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:03.841452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d120347f-8683-4141-b53b-4fa2f8cad181 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:03.842752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d120347f-8683-4141-b53b-4fa2f8cad181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:03.879037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:03.947027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 702/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:04.240152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:04.241687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:04.328406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:04.413031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48feb7-dcb0-4b38-a641-8c637189c702 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:04.543995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:04.544526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:04.544808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:04.545110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:04.546821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:04.588861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:04.642993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:04.644575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899566b9-0af5-4261-ab6d-aaa7870023f4 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:04.663258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 686/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:07.088152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:07.088723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:07.088825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:07.090657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 703/1389] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:07.097877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096276d1-c159-4707-9103-a83d2d4ecb34 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:07.098416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096276d1-c159-4707-9103-a83d2d4ecb34 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:07.098670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096276d1-c159-4707-9103-a83d2d4ecb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:07.183664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-096276d1-c159-4707-9103-a83d2d4ecb34 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:07.185380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-096276d1-c159-4707-9103-a83d2d4ecb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:07.306173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 687/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:07.693509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:07.695075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:07.871844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c46e3-6136-4df1-a65c-c04820d5220e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:07.890009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:07.990868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:07.991590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:07.991871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:07.992203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:07.994291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:08.103910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:08.105547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7d527-140c-41a6-a1b0-ae2639656d8d service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:08.126454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 704/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:10.104112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c304e-0a12-4baf-855c-7e99a67ceb76 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.104643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c304e-0a12-4baf-855c-7e99a67ceb76 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.104643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c304e-0a12-4baf-855c-7e99a67ceb76 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.106300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 688/1392] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:10.106937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f71dd-d2f3-44e6-ad89-9b5e206584cd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.107367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f71dd-d2f3-44e6-ad89-9b5e206584cd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.107636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f71dd-d2f3-44e6-ad89-9b5e206584cd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.108859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 705/1393] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:10.111773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.112059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.112333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.114016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef974e-c733-4191-b453-ff8f2ceb1971 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.114334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef974e-c733-4191-b453-ff8f2ceb1971 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.114603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef974e-c733-4191-b453-ff8f2ceb1971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.128713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.141347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.184137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:10.185399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.185929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-18ef974e-c733-4191-b453-ff8f2ceb1971 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:10.187143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-18ef974e-c733-4191-b453-ff8f2ceb1971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.286836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 689/1394] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:10.288085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 706/1395] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:10.579884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:10.581113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.588951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1ec0-10de-4e83-b546-cbe9bf4684e2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.589238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1ec0-10de-4e83-b546-cbe9bf4684e2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.589511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1ec0-10de-4e83-b546-cbe9bf4684e2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.591907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 707/1396] 10.222.0.52 () {54 vars in 967 bytes} [Wed Aug 24 10:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:36:10.597137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.597413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.597681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.671734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.675495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] MFA Rules not processed for user `c648572b085545719bd8b6f1dcdf1a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:10.676967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.698666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf6d49-9e4a-4c5b-b876-6f29b34ae34c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:10.719041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.756384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 708/1397] 10.222.0.52 () {58 vars in 1064 bytes} [Wed Aug 24 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:10.764118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:10.771507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7262-eb2f-4379-a95c-031b209be7c8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:10.815296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:10.815825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.816124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.816427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.818037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.858989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:10.859607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:10.859888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:10.860164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:10.861785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:10.912294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.914866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:10.916586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ce05-1783-4782-8597-8a0723f269d5 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:10.936814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 690/1398] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:10.973783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:10.975262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54d773-a632-4b0e-9723-784d72a7175b service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:10.981195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:10.997504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 709/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:36:11.776937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e7a9f-d13a-4a6f-a56a-8938e5a88da5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:11.777485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e7a9f-d13a-4a6f-a56a-8938e5a88da5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:11.777485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e7a9f-d13a-4a6f-a56a-8938e5a88da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:11.846153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-562e7a9f-d13a-4a6f-a56a-8938e5a88da5 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:11.847429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-562e7a9f-d13a-4a6f-a56a-8938e5a88da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:11.936222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 691/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:11.983685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:11.984200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:11.984335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:11.985596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 710/1401] 10.222.0.52 () {54 vars in 943 bytes} [Wed Aug 24 10:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:11.991932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e26d-acff-46f0-9356-cce716608a72 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:11.992218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e26d-acff-46f0-9356-cce716608a72 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:11.992712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e26d-acff-46f0-9356-cce716608a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:12.075890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5425e26d-acff-46f0-9356-cce716608a72 None None] MFA Rules not processed for user `486dd7c41a60456892803f8acbb5e36e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:12.077044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5425e26d-acff-46f0-9356-cce716608a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:12.095935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:12.186685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 692/1402] 10.222.0.52 () {58 vars in 1040 bytes} [Wed Aug 24 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:12.196717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:12.198268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:12.337245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2b4f-e231-4007-b3d7-2ef6adf13b61 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:12.414562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:12.442002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:12.442716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:12.442994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:12.443268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:12.444927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:12.535610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:12.537213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469f5e5-a2ea-416a-9e1f-c584d95b5e8c service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:12.545255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 711/1403] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:36:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:36:12.885174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:12.885944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:12.885944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:12.887388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 693/1404] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:12.892769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a85f8-eff9-44d4-a99c-6c598e1b0c93 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:12.893053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a85f8-eff9-44d4-a99c-6c598e1b0c93 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:12.893332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a85f8-eff9-44d4-a99c-6c598e1b0c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:12.972734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b98a85f8-eff9-44d4-a99c-6c598e1b0c93 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:12.974035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b98a85f8-eff9-44d4-a99c-6c598e1b0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:13.039176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:13.079507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 712/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:13.366962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:13.368654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:13.527809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:13.539905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d337c-ea92-45c9-9718-7df0674c870c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:13.672256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:13.672864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:13.673141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:13.673409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:13.675072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:13.776271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:13.777963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dba933-f196-4189-9c1f-6c87b25ab10f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:13.788924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:13.799564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 694/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:15.769539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:15.770122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:15.770122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:15.771614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 713/1407] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:15.776688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b23b1-282b-40d9-9238-57a1107ba797 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:15.777155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b23b1-282b-40d9-9238-57a1107ba797 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:15.777247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b23b1-282b-40d9-9238-57a1107ba797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:15.853060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2b3b23b1-282b-40d9-9238-57a1107ba797 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:15.854413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2b3b23b1-282b-40d9-9238-57a1107ba797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:15.967379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 695/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:16.256960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:16.258631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:16.417589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850923b-acaf-4379-bc31-c88cee378005 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:16.472510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:16.541311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:16.542037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:16.542405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:16.543292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:16.544964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:16.651329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:16.653061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d030900-3334-4d15-92cc-03673b07fb7c service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:16.674255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 714/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:25.965646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=67 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:26.671890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=76 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:34.533001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be918f2-6d52-4d44-8473-ff1a5cdecade None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:34.533550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be918f2-6d52-4d44-8473-ff1a5cdecade None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:34.533550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be918f2-6d52-4d44-8473-ff1a5cdecade None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:34.534832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 696/1410] 10.222.0.52 () {54 vars in 918 bytes} [Wed Aug 24 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:34.540136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb816a9-6dcd-49a4-9ed3-ef47cdf3e26d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:34.540555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb816a9-6dcd-49a4-9ed3-ef47cdf3e26d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:34.540691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb816a9-6dcd-49a4-9ed3-ef47cdf3e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:34.617240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4fb816a9-6dcd-49a4-9ed3-ef47cdf3e26d None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:34.618490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4fb816a9-6dcd-49a4-9ed3-ef47cdf3e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:34.722083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 715/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:34.736112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25da69-9364-4981-b628-d45a5e5674f6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:34.736394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25da69-9364-4981-b628-d45a5e5674f6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:34.736667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25da69-9364-4981-b628-d45a5e5674f6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:34.738012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 697/1412] 10.222.0.52 () {54 vars in 918 bytes} [Wed Aug 24 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:34.742543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2095-6f8d-4ce2-bba1-2167d6dad3ed None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:34.742833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2095-6f8d-4ce2-bba1-2167d6dad3ed None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:34.743110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2095-6f8d-4ce2-bba1-2167d6dad3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:34.814803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:34.817627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-93ed2095-6f8d-4ce2-bba1-2167d6dad3ed None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:34.819422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-93ed2095-6f8d-4ce2-bba1-2167d6dad3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:34.935281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 716/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:37.330483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:37.331045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:37.331045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:37.332391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 698/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:37.339947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09113a-2e7a-46f9-bd5f-a0c4ded9980b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:37.340687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09113a-2e7a-46f9-bd5f-a0c4ded9980b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:37.340687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09113a-2e7a-46f9-bd5f-a0c4ded9980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:37.409083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6f09113a-2e7a-46f9-bd5f-a0c4ded9980b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:37.410270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6f09113a-2e7a-46f9-bd5f-a0c4ded9980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:37.467297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:37.514789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 717/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:37.809069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:37.810862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:37.972997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b0b41-44d1-446f-b1fd-db68501f779f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:38.049406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:38.091719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:38.092321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:38.092595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:38.092851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:38.094811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:38.189151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:38.190811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937f81-cef3-42b5-afb6-062acda9cbf6 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:38.211367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 699/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:39.119901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.120466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.120466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.122335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 718/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:39.127889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bfa5-acee-4630-8320-9598890dd49e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.128357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bfa5-acee-4630-8320-9598890dd49e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.128466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bfa5-acee-4630-8320-9598890dd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.210529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2c97bfa5-acee-4630-8320-9598890dd49e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:39.211757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2c97bfa5-acee-4630-8320-9598890dd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:39.240265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:39.313490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 700/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:39.467281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:39.468817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:39.626508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc90ad-8a61-4e84-9dfd-49355f3e18d9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:39.674448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:39.752703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:39.752934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:39.753147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:39.753423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:39.755036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:39.847112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:39.848756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43402ffd-97b6-4b05-8d39-3bdccf6d481a service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:39.867520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 719/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:40.777435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:40.778007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:40.778007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:40.779468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 701/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:40.786214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d40-d814-4816-b25c-3343694dd9bb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:40.786675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d40-d814-4816-b25c-3343694dd9bb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:40.786812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d40-d814-4816-b25c-3343694dd9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:40.847175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:40.869642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1f676d40-d814-4816-b25c-3343694dd9bb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:40.871403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f676d40-d814-4816-b25c-3343694dd9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:40.976026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 720/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:41.129738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:41.131343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:41.280206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f5f2b-183e-4b77-8cab-aa14f90cdb47 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:41.293452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:41.403851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:41.404455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:41.404728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:41.404996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:41.406669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:41.500264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:41.501893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b30b6-0693-43b6-9817-bc25d8bebb00 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:41.519982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 702/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:42.391847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:42.392413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:42.392413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:42.393743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 721/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:42.398831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3e50-2192-4217-ae54-3d0d7d6bb6f3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:42.399269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3e50-2192-4217-ae54-3d0d7d6bb6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:42.399372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3e50-2192-4217-ae54-3d0d7d6bb6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:42.419399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:42.477378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5abb3e50-2192-4217-ae54-3d0d7d6bb6f3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:42.478636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5abb3e50-2192-4217-ae54-3d0d7d6bb6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:42.577545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 703/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:42.729512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:42.731032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:42.842577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:42.878933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125204b-d7e2-4f1c-a4a7-23d5d9d7bcf7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:42.992884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:42.993401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:42.993680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:42.993951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:42.995596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:43.077504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:43.091483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:43.093090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1079cc-f36c-45e5-a44c-d8dd352bce22 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:43.113094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 722/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:43.989191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:43.989772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:43.989772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:43.991144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 704/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:43.996392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd7e98-f2e5-401d-b5c0-320e514df81d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:43.996837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd7e98-f2e5-401d-b5c0-320e514df81d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:43.996952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd7e98-f2e5-401d-b5c0-320e514df81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:44.075518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9cfd7e98-f2e5-401d-b5c0-320e514df81d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:44.076741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9cfd7e98-f2e5-401d-b5c0-320e514df81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:44.178797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 723/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:44.331148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:44.332597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:44.424192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:44.486402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1246e2-bf59-4089-8fc8-c416d10215ba None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:44.611614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:44.612130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:44.612405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:44.612671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:44.614303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:44.665964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:44.710495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:44.712117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03c702-2ef9-4d2c-be32-613422b290a5 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:44.730861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 705/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:45.543785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.544352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.544352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.545689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 724/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:45.550807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5d28-36d8-423a-b5b3-b781b35bd79f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:45.551219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5d28-36d8-423a-b5b3-b781b35bd79f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:45.551347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df5d28-36d8-423a-b5b3-b781b35bd79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:45.627930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-76df5d28-36d8-423a-b5b3-b781b35bd79f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:45.629197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-76df5d28-36d8-423a-b5b3-b781b35bd79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.733774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 706/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:45.887707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:45.889274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:45.940261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.046326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a14e8c-34f4-4f2f-9627-fb359b94c414 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:46.169083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:46.169694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:46.169976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:46.170306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:46.171869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:46.180357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:46.272278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:46.273899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44656cc-58a4-4ab7-8697-ce978807b8e0 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:46.293741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 725/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:47.115430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.115969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.115969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.117258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 707/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 10:36:47.122364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5753-50ff-4471-9ba0-7cc412943c8a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.122804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5753-50ff-4471-9ba0-7cc412943c8a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.122917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f5753-50ff-4471-9ba0-7cc412943c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.201344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f98f5753-50ff-4471-9ba0-7cc412943c8a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:47.202602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f98f5753-50ff-4471-9ba0-7cc412943c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.272976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.302819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 726/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:47.454559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:47.456081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.474225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.606311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49463-c8bf-4b19-ba7e-3141664f2aa6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:47.694671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:47.723516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:47.724034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:47.724304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:47.724570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:47.726217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:47.822947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:47.825126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f5ee-f4ab-438f-8cbd-a24901f96691 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:47.843857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 708/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:48.663703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:48.664299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:48.664299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:48.665626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 727/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:48.670947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0724-1545-4d93-b0a1-3a9280bbc7e3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:48.671417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0724-1545-4d93-b0a1-3a9280bbc7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:48.671525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb0724-1545-4d93-b0a1-3a9280bbc7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:48.748985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bafb0724-1545-4d93-b0a1-3a9280bbc7e3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:48.750257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bafb0724-1545-4d93-b0a1-3a9280bbc7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:48.792896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:48.849336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 709/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:48.998349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:48.999985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:49.151279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803d54c-a0f4-4064-8e7f-f05f3e42123e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:49.206633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:49.268218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:49.268820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:49.269098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:49.269428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:49.271221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:49.363310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:49.364924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d434d9-bf04-429e-adb5-27ede62e08fa service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:49.383221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 728/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:50.194089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:50.194666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:50.194666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:50.196015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 710/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:50.201479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960d46-c494-4d8c-a676-daa51278fdd3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:50.201866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960d46-c494-4d8c-a676-daa51278fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:50.202029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21960d46-c494-4d8c-a676-daa51278fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:50.277509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-21960d46-c494-4d8c-a676-daa51278fdd3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:50.278790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-21960d46-c494-4d8c-a676-daa51278fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:50.280840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:50.377204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 729/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:50.529060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:50.530567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:50.676972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0b483-6a96-47a8-b607-c66d7a7d8d79 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:50.704458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:50.790118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:50.790652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:50.790931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:50.791201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:50.793469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:50.884604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:50.887008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab87b7-2ad2-4363-8d36-fd9b9bab1a5d service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:50.905513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 711/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:52.751543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:52.752083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:52.752083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:52.753900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 730/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:52.759484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeca39-d8e9-4119-a294-2443c93babfd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:52.759897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeca39-d8e9-4119-a294-2443c93babfd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:52.760031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeca39-d8e9-4119-a294-2443c93babfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:52.800454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:52.827043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6deeca39-d8e9-4119-a294-2443c93babfd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:52.828273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6deeca39-d8e9-4119-a294-2443c93babfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:52.925758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 712/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:53.220419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:53.222209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:53.323841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3172c-d4ff-4e49-9eec-54765e3f292b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:53.358660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:53.402202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:53.402817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:53.403101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:53.403359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:53.404961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:53.513184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:53.514583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b99ff-7a17-4c23-865b-6250cfeb029c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:53.533085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 731/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:55.776502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:55.777091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:55.777091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:55.779099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 713/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:55.784424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290c4ad-1703-4728-b973-3e50fbab1024 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:55.784846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290c4ad-1703-4728-b973-3e50fbab1024 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:55.784984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290c4ad-1703-4728-b973-3e50fbab1024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:55.853906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8290c4ad-1703-4728-b973-3e50fbab1024 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:55.855080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8290c4ad-1703-4728-b973-3e50fbab1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:55.868224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:55.960383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 732/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:36:56.291956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:56.293799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:56.399494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b96759-ac84-4d61-9d8e-e1e2c3e05718 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:56.411972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:56.473992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:56.474892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:56.475170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:56.475437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:56.477077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:56.587456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:56.588813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16db553-142c-4e6b-a7d1-005b0a10a858 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:56.606697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 714/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:36:58.841114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:58.841543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:58.841665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:58.843086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 733/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:36:58.851287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89668b-330f-41ca-938f-4e40d1e1c568 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:58.851734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89668b-330f-41ca-938f-4e40d1e1c568 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:58.851851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89668b-330f-41ca-938f-4e40d1e1c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:58.900316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:58.919656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8b89668b-330f-41ca-938f-4e40d1e1c568 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:36:58.920879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8b89668b-330f-41ca-938f-4e40d1e1c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:59.026579 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 715/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:36:59.350429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:36:59.352011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:59.454559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707be0a9-eb51-4c87-b287-3f27d085ae88 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:36:59.495709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:36:59.532156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:36:59.532779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:36:59.533057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:36:59.533325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:36:59.534946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:36:59.645937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:36:59.647659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec57d-6c33-4d49-8143-9a50bdf9de36 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:36:59.667359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 734/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:01.679212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:01.679739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:01.679855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:01.681310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 716/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:01.686897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23197-cd63-4ca8-8a3f-938a40383797 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:01.687306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23197-cd63-4ca8-8a3f-938a40383797 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:01.687453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23197-cd63-4ca8-8a3f-938a40383797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:01.754645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1ca23197-cd63-4ca8-8a3f-938a40383797 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:01.755868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1ca23197-cd63-4ca8-8a3f-938a40383797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:01.777097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:01.860171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 735/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:02.142285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:02.143913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:02.250239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1c85a-7ad1-4264-aa4c-ec6c8361048c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:02.269908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:02.324635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:02.325235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:02.325562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:02.325893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:02.327788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:02.439135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:02.440583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d70c17-c5e1-4221-ac28-b93bca0e0767 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:02.458425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 717/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:04.432208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:04.432763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:04.432763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:04.434712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 736/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:04.440175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed914e-58d9-48a0-a74a-cdcb50612860 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:04.440626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed914e-58d9-48a0-a74a-cdcb50612860 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:04.440752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed914e-58d9-48a0-a74a-cdcb50612860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:04.505589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:04.508270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-27ed914e-58d9-48a0-a74a-cdcb50612860 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:04.510104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-27ed914e-58d9-48a0-a74a-cdcb50612860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:04.608608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 718/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:04.917860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:04.919994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:05.024626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb918fd-f83c-4302-ba18-0fc1b6209645 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:05.077336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:05.105208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:05.105743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:05.106021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:05.106319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:05.107917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:05.216314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:05.217741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782306b5-c99f-4afd-bb12-8afedfc98653 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:05.235386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 737/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:07.273779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:07.274392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:07.274392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:07.275881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 719/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:07.281122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d0f8-a511-4ebf-9a86-360a213acbfe None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:07.281607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d0f8-a511-4ebf-9a86-360a213acbfe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:07.281708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84d0f8-a511-4ebf-9a86-360a213acbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:07.346687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8a84d0f8-a511-4ebf-9a86-360a213acbfe None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:07.347948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8a84d0f8-a511-4ebf-9a86-360a213acbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:07.378311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:07.445679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 738/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:07.731241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:07.732777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:07.836612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f3dc7-80c0-4147-890c-5a1223fd3342 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:07.864610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:07.910863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:07.911462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:07.911737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:07.912003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:07.913588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:08.021560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:08.023026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae7ac-8306-4445-ae18-25595a70a7de service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:08.040561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 720/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:09.995017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:09.995632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:09.995632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:09.996968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 739/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:10.002489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bd4b-81b5-474f-a415-003be24d0936 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:10.002947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bd4b-81b5-474f-a415-003be24d0936 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:10.003053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bd4b-81b5-474f-a415-003be24d0936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:10.068314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-32e0bd4b-81b5-474f-a415-003be24d0936 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:10.069528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32e0bd4b-81b5-474f-a415-003be24d0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:10.077750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:10.170705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 721/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:10.451693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:10.453270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:10.557930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826198-5e9d-4e1a-81da-87e8a6e07aa0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:10.612839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:10.631839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:10.632452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:10.632736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:10.633013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:10.634661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:10.742630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:10.743981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9396f2-dc9e-495c-8047-9dba109c01f5 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:10.764379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 740/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:12.724626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:12.725178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:12.725178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:12.726563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 722/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:12.732541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cd33-6291-4391-8ebb-b4091af93220 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:12.732963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cd33-6291-4391-8ebb-b4091af93220 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:12.733090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cd33-6291-4391-8ebb-b4091af93220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:12.799886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ea83cd33-6291-4391-8ebb-b4091af93220 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:12.801087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ea83cd33-6291-4391-8ebb-b4091af93220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:12.839531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:12.905754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 741/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:13.188490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:13.190228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:13.295201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b53251-a1b1-4e42-9d2f-dfb934b01879 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:13.334405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:13.374978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:13.375664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:13.375946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:13.376281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:13.378213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:13.498482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:13.500107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ef38-ede9-4cc9-9257-b5d9f7cc4bee service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:13.521194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 723/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:15.473750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:15.474454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:15.474454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:15.475676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 742/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:15.481446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ab4-847d-461e-ae00-d5e66dfb2c87 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:15.481908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ab4-847d-461e-ae00-d5e66dfb2c87 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:15.482166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f168ab4-847d-461e-ae00-d5e66dfb2c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:15.548856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6f168ab4-847d-461e-ae00-d5e66dfb2c87 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:15.550134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6f168ab4-847d-461e-ae00-d5e66dfb2c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:15.568214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:15.647089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 724/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:15.930263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:15.931797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:16.035566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c5386-2dc1-447c-a16d-104609a584cd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:16.102800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:16.110240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:16.110843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:16.111117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:16.111383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:16.112960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:16.221696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:16.223151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b6611-f56b-4395-a09d-08b1cd389e7b service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:16.241324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 743/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:18.385017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:18.385614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:18.385614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:18.387422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 725/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:18.392880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626d4e-b40b-4037-b2c1-d272d60d4681 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:18.393334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626d4e-b40b-4037-b2c1-d272d60d4681 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:18.393442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626d4e-b40b-4037-b2c1-d272d60d4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:18.459029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-75626d4e-b40b-4037-b2c1-d272d60d4681 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:18.460241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-75626d4e-b40b-4037-b2c1-d272d60d4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:18.508075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:18.556910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 744/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:18.841476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:18.843059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:18.948093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1cb74-e53b-4220-999d-016eb1864f4c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:18.994619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:19.025494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:19.026109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:19.026386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:19.026650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:19.028265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:19.140428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:19.141862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76aa64-c502-4e68-b0b4-f599b65a839a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:19.159833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 726/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:28.555165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=22 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:29.157472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=66 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.004590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb59a-e1a6-473a-87d9-90a14f327e41 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.005196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb59a-e1a6-473a-87d9-90a14f327e41 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.005196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babb59a-e1a6-473a-87d9-90a14f327e41 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.006541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 745/1471] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:39.012408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d23e2b-d020-4240-a663-2de57f4b5b2c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.012847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d23e2b-d020-4240-a663-2de57f4b5b2c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.012947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d23e2b-d020-4240-a663-2de57f4b5b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.083265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d6d23e2b-d020-4240-a663-2de57f4b5b2c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:39.084480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d6d23e2b-d020-4240-a663-2de57f4b5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.187482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 727/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:39.482551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.482862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.483202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.484679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 746/1473] 10.222.0.52 () {54 vars in 967 bytes} [Wed Aug 24 10:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:39.489820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1490ba-7141-41d1-998e-dccf063fe5e0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.490193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1490ba-7141-41d1-998e-dccf063fe5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.490429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1490ba-7141-41d1-998e-dccf063fe5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.572400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0d1490ba-7141-41d1-998e-dccf063fe5e0 None None] MFA Rules not processed for user `c648572b085545719bd8b6f1dcdf1a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:39.573663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0d1490ba-7141-41d1-998e-dccf063fe5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.595265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.655426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 728/1474] 10.222.0.52 () {58 vars in 1064 bytes} [Wed Aug 24 10:37:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:39.663008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:39.664582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.774527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5406d4-963f-4d61-b385-6aae6c1ddaa3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:39.863577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:39.864188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:39.864465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:39.864736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:39.866395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:39.924451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:39.986269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:39.988101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce8c3-d0aa-40d3-ad1a-bb01debccd96 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:40.009745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 747/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:42.021674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:42.022305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:42.022305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:42.023637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 729/1476] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:42.029680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d378e-bc4b-4b29-8f58-7a457c8982a2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:42.030278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d378e-bc4b-4b29-8f58-7a457c8982a2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:42.030278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d378e-bc4b-4b29-8f58-7a457c8982a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:42.105975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d07d378e-bc4b-4b29-8f58-7a457c8982a2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:42.107217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d07d378e-bc4b-4b29-8f58-7a457c8982a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:42.213026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 748/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:42.489869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:42.491798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:42.626740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdbcd5-f7c8-4967-966e-82284672fb5f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:42.680565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:42.729798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:42.730440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:42.731221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:42.731488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:42.732133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:42.733921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:37:42.733921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:37:42.733921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:37:42.735116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0d0eb-e343-44e4-93d8-bed2122930dd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:42.754542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 730/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Wed Aug 24 10:37:42 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:37:44.784811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:44.785359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:44.785359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:44.786827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 749/1479] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:44.792909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a273-68e1-446b-8e50-28a945f55fb0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:44.793969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a273-68e1-446b-8e50-28a945f55fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:44.794119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84a273-68e1-446b-8e50-28a945f55fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:44.867403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3f84a273-68e1-446b-8e50-28a945f55fb0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:44.868672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3f84a273-68e1-446b-8e50-28a945f55fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:44.972052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 731/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:45.268768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:45.270407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:45.280276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:45.414960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47276466-437e-40a7-a1c6-73d9a443b40a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:45.493251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:45.527308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:45.527883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:45.528166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:45.528442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:45.530061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:45.618963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:45.620566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b287ca1-cba5-4b2c-a15d-d0fc2e4543f4 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:45.639256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 750/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:47.725475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:47.726057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:47.726057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:47.727454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 732/1482] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:47.733471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc7d0-b05d-4847-855d-da32216168f5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:47.733939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc7d0-b05d-4847-855d-da32216168f5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:47.734058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dc7d0-b05d-4847-855d-da32216168f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:47.810996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a60dc7d0-b05d-4847-855d-da32216168f5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:47.812255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a60dc7d0-b05d-4847-855d-da32216168f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:47.862592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:47.920538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 751/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:48.206334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:48.207888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:48.233832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:48.313322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbffc-5e01-48ef-818b-bf57d09ff0fe None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:48.387885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:48.388485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:48.388759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:48.389024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:48.390659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:48.464771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:48.500245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:48.501740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fc480-0536-4ddd-9110-b21bc1e7986e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:48.520335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 733/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:50.517835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:50.518416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:50.518416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:50.519758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 752/1485] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:50.525210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3384ac-b4ea-4605-8528-df768910d0b4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:50.525679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3384ac-b4ea-4605-8528-df768910d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:50.525798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3384ac-b4ea-4605-8528-df768910d0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:50.592508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9d3384ac-b4ea-4605-8528-df768910d0b4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:50.593724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9d3384ac-b4ea-4605-8528-df768910d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:50.693124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 734/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:50.988404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:50.989949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:51.099939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a912-9c6a-47ed-a681-4415800f48fe None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:51.171570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:51.173243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:51.173858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:51.174172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:51.174458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:51.176593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:51.284655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:51.286214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfad42-2e3f-4115-9ba2-2a7254f4c5bb service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:51.303873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 753/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:53.333566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:53.334247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:53.334247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:53.335524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 735/1488] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:53.341026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afda4a-31ca-424f-8e34-df45ec4a638f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:53.341459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afda4a-31ca-424f-8e34-df45ec4a638f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:53.341604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afda4a-31ca-424f-8e34-df45ec4a638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:53.407528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c6afda4a-31ca-424f-8e34-df45ec4a638f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:53.408753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c6afda4a-31ca-424f-8e34-df45ec4a638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:53.461030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:53.504697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 754/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:37:53.797449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:53.799072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:53.836138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:53.905868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad11db-c6be-4e0e-86e2-adaea507eb30 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:53.981157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:53.981809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:53.982101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:53.982371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:53.983975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:54.064138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:54.092641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:54.094096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe02af-3b38-4d02-8b32-eaedd171cae6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:54.112527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 736/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:37:56.212447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:56.213034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:56.213034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:56.214433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 755/1491] 10.222.0.52 () {54 vars in 927 bytes} [Wed Aug 24 10:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:37:56.219781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab7f6-4077-4856-839d-226123950421 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:56.220222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab7f6-4077-4856-839d-226123950421 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:56.220427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fab7f6-4077-4856-839d-226123950421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:56.286428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b8fab7f6-4077-4856-839d-226123950421 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:37:56.287644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b8fab7f6-4077-4856-839d-226123950421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:56.388836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 737/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Wed Aug 24 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:37:56.680576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:37:56.682152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:56.908859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a382854-7dc7-4137-aa4c-13049d7842aa None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:37:56.988394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:37:56.989090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:37:56.989443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:37:56.989811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:37:56.991947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:37:57.002926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:37:57.115197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:37:57.116815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853d884-2757-467b-aabd-b5aca1524b94 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:37:57.135276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 756/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:38:06.387559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=82 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:38:07.132996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=50 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:09.162300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.163195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.163195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.242870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:09.244099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.346242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 738/1494] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:09.354592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.355139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.355262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.433457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:09.434610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.534199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 757/1495] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:39:09.539059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:09.540306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.551955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3e917-8d06-4272-bd88-9515e80d2a1b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:09.621654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:09.656467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:09.657236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.657510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.657777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.658459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:39:09.658789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:09.659937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:09.659937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:39:09.659937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:39:09.660854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:09.673244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 739/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:39:09.682018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:09.691814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb49b4-bbc7-4119-b581-adf246bcf579 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:09.757743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:09.791628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:09.792782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:09.793071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:09.793337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:09.793951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:09.795728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:09.795728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:39:09.795728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:39:09.796906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:09.858542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 758/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:39:09 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:39:09.864835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:09.866434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:09.901662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eee13-27dc-4ed4-a770-78938d8a1991 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:09.999620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:10.000138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.000409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.000672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.001302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:10.002350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:10.002350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:39:10.002350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:39:10.003563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:10.049317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 740/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:39:09 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:39:10.053687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:10.055254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:10.120854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938ad3d-5d38-4e14-bd57-107a9e0c11a5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:10.204578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:10.216810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:10.217424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.217701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.217969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.218646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:10.219661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:10.219661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:39:10.219661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:39:10.220546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:10.235484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 759/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:39:10.239765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:10.241294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:10.253048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89acae-371b-4b54-9495-75b20e3c5b1d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:10.278901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:10.353307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:10.353913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.354221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.354493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.355136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:10.356156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:10.356156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:39:10.356156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:39:10.357048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cc0e2-5c2c-4ec0-ba9d-ddd35aad3672 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:10.370685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 741/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:39:10.375303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:10.377969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:10.414514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf1ff4-60fc-404c-9dd7-d1f254b087ef admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:10.512119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:10.512952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.513231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.513500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] PATH_INFO: `/v3/projects/19c5f5ee4eea4b7cb7db262f9685abb0/users/ff84e464118c4b67a7fd398dc95e5421/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.536663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c5f5ee4eea4b7cb7db262f9685abb0, user_id=ff84e464118c4b67a7fd398dc95e5421, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:10.537822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:10.537822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:39:10.537822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:39:10.539847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025b229-ff95-4671-919f-fe79b2a0afb4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:10.572335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 760/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:39:10 2022] PUT /identity/v3/projects/19c5f5ee4eea4b7cb7db262f9685abb0/users/ff84e464118c4b67a7fd398dc95e5421/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:39:10.585137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267687ba-48b5-48f3-bfa4-15ff2bc3c2d2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.585567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267687ba-48b5-48f3-bfa4-15ff2bc3c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.585948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267687ba-48b5-48f3-bfa4-15ff2bc3c2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.650972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-267687ba-48b5-48f3-bfa4-15ff2bc3c2d2 None None] MFA Rules not processed for user `ff84e464118c4b67a7fd398dc95e5421`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:10.652910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-267687ba-48b5-48f3-bfa4-15ff2bc3c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:10.741435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 742/1502] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:10.758380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.758675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.758949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.760303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 761/1503] 10.222.0.52 () {54 vars in 964 bytes} [Wed Aug 24 10:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:10.766216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1cc2-bd05-4b16-85d0-af911dc55671 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:10.766428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1cc2-bd05-4b16-85d0-af911dc55671 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:10.766704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1cc2-bd05-4b16-85d0-af911dc55671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:10.919058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:10.973034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-41af1cc2-bd05-4b16-85d0-af911dc55671 None None] MFA Rules not processed for user `273e5c26e347484d84b6b1b196b11282`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:10.974292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-41af1cc2-bd05-4b16-85d0-af911dc55671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:11.052464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 743/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Wed Aug 24 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:11.061020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:11.062562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:11.114047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:11.171242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80825b5-e242-4fd8-bc92-7c1146c058c3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:11.248185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:11.248788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:11.249061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:11.249328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:11.250955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:11.354551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:11.356449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:11.360005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:11.376556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 762/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:11.422284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167f62-2f94-4619-a284-262dd2252202 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:11.422776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167f62-2f94-4619-a284-262dd2252202 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:11.422927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167f62-2f94-4619-a284-262dd2252202 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:11.424076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 744/1506] 10.222.0.52 () {52 vars in 830 bytes} [Wed Aug 24 10:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:39:11.427903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:11.429127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:11.531979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed914f-04ea-4863-8f0f-38faecbbe6a7 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:11.626460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:11.627003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:11.627278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:11.627547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] PATH_INFO: `/v3/users/ff84e464118c4b67a7fd398dc95e5421` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:11.640446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff84e464118c4b67a7fd398dc95e5421)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:11.641574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:11.641574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:39:11.641574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:39:11.642650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:11.653033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:11.712617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff84e464118c4b67a7fd398dc95e5421'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:11.728697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff84e464118c4b67a7fd398dc95e5421'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:11.752223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff84e464118c4b67a7fd398dc95e5421'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:11.752812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff84e464118c4b67a7fd398dc95e5421'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:11.763045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff84e464118c4b67a7fd398dc95e5421'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:11.769015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 763/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:39:11 2022] DELETE /identity/v3/users/ff84e464118c4b67a7fd398dc95e5421 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:39:11.773436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:11.773737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:11.774006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:11.834514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:39:11.835835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:11.916903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:11.933871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 745/1508] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:39:11.943636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:11.944864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:12.054329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898df5-4443-4dce-9b7a-e80681837aa0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:12.113131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:12.135617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:12.136732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:12.137006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:12.137276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:12.139191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:12.253788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:12.255191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e66c-f99f-4ec8-bb3c-3507dec2df8d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:12.275100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 764/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:39:12.622788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:39:12.624083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:39:12.639978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887e9f-f2e2-4b3c-a450-bd33aee91d7f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:39:12.742021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:39:12.742863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:39:12.743145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:39:12.743416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] PATH_INFO: `/v3/projects/19c5f5ee4eea4b7cb7db262f9685abb0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:39:12.755121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c5f5ee4eea4b7cb7db262f9685abb0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:39:12.756197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:39:12.756197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:39:12.756197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:39:12.757382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:39:12.819542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c5f5ee4eea4b7cb7db262f9685abb0', 'request_id': 'req-cba66032-d3be-4651-a081-e6edc18d80c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:12.832959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c5f5ee4eea4b7cb7db262f9685abb0', 'request_id': 'req-cba66032-d3be-4651-a081-e6edc18d80c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:12.844461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c5f5ee4eea4b7cb7db262f9685abb0', 'request_id': 'req-cba66032-d3be-4651-a081-e6edc18d80c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:12.869347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] The token cache is being invalidate because project 19c5f5ee4eea4b7cb7db262f9685abb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:39:12.869636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:12.870236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cba66032-d3be-4651-a081-e6edc18d80c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:39:12.872142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 746/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:39:12 2022] DELETE /identity/v3/projects/19c5f5ee4eea4b7cb7db262f9685abb0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:39:22.272701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=62 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:39:22.867215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:55.237247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e509ad-99c6-4b94-bd43-f8297cea0640 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:55.237881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e509ad-99c6-4b94-bd43-f8297cea0640 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:55.237881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e509ad-99c6-4b94-bd43-f8297cea0640 None None] PATH_INFO: `/v3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:55.239248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 765/1511] 10.222.0.60 () {54 vars in 925 bytes} [Wed Aug 24 10:40:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:40:55.247606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3adb-8845-47e5-904b-150fbd60d05b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:55.248123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3adb-8845-47e5-904b-150fbd60d05b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:55.248123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3adb-8845-47e5-904b-150fbd60d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:55.336116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7b9e3adb-8845-47e5-904b-150fbd60d05b None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:55.337344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b9e3adb-8845-47e5-904b-150fbd60d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:55.461526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 747/1512] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 24 10:40:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:56.215171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:56.215458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:56.215734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:56.217091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 766/1513] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:56.222027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2ab8-a1a5-4cf8-8d04-fca44284c68e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:56.222342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2ab8-a1a5-4cf8-8d04-fca44284c68e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:56.222642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b2ab8-a1a5-4cf8-8d04-fca44284c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:56.284965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-331b2ab8-a1a5-4cf8-8d04-fca44284c68e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:56.286216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-331b2ab8-a1a5-4cf8-8d04-fca44284c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:56.313525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:40:56.372282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 748/1514] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:56.528388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:56.530539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:56.633425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6fbc-7c4e-4ec3-816d-de035aa04d00 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:56.639244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:56.639863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:56.640151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:56.640426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:56.648930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:56.650560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3144c7-636e-4fae-af92-7b71b92fc94a service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:56.660210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 767/1515] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:40:57.491005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321f8c-5a36-4106-9ee5-b284848d81a8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.491592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321f8c-5a36-4106-9ee5-b284848d81a8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.491592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24321f8c-5a36-4106-9ee5-b284848d81a8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.492955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 749/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:40:57.498599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d68bb-4a28-4a82-94f6-7213d6548125 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.498886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d68bb-4a28-4a82-94f6-7213d6548125 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.499159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d68bb-4a28-4a82-94f6-7213d6548125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.519743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4b4d68bb-4a28-4a82-94f6-7213d6548125 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:40:57.520938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4b4d68bb-4a28-4a82-94f6-7213d6548125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:40:57.529759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 768/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:40:57.684289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24321f8c-5a36-4106-9ee5-b284848d81a8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:40:57.698544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24321f8c-5a36-4106-9ee5-b284848d81a8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:40:57.704060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:40:57.704661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:40:57.704933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:40:57.705195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:40:57.713866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:40:57.716136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8004b1a-c55f-4e52-a51f-3409321b48e8 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:40:57.725945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 750/1518] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:03.391246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21f20-0878-4723-8775-3da5ea1087f7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.391790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21f20-0878-4723-8775-3da5ea1087f7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.391790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21f20-0878-4723-8775-3da5ea1087f7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.393126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 769/1519] 10.222.0.52 () {54 vars in 961 bytes} [Wed Aug 24 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:03.398137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f03a9-df23-4c0f-aac6-436fa2767360 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.398584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f03a9-df23-4c0f-aac6-436fa2767360 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.398693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f03a9-df23-4c0f-aac6-436fa2767360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.418830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-464f03a9-df23-4c0f-aac6-436fa2767360 None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:03.420072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-464f03a9-df23-4c0f-aac6-436fa2767360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:03.428805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 751/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Wed Aug 24 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:03.436873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f21f20-0878-4723-8775-3da5ea1087f7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:03.450859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f21f20-0878-4723-8775-3da5ea1087f7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:03.455767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:03.456363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:03.456644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:03.456916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:03.465822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:03.467433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aad62-cd77-4c1f-92fe-56372c134cad service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:03.477018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 770/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:41:08.966028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d134-469f-485b-b93e-b72a0c5981ff None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.966610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d134-469f-485b-b93e-b72a0c5981ff None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.966722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d134-469f-485b-b93e-b72a0c5981ff None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.968243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:08.972999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f05cd-92e8-4a81-bcdc-09f75c8e8e20 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:08.973467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f05cd-92e8-4a81-bcdc-09f75c8e8e20 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:08.973586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f05cd-92e8-4a81-bcdc-09f75c8e8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:08.992358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-150f05cd-92e8-4a81-bcdc-09f75c8e8e20 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:08.993545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-150f05cd-92e8-4a81-bcdc-09f75c8e8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:09.002031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:09.158318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d134-469f-485b-b93e-b72a0c5981ff None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:09.174517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d134-469f-485b-b93e-b72a0c5981ff None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:09.182413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:09.183045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:09.183385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:09.183760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:09.193665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:09.195539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35efd-0dd9-49b1-915e-943cac96f2d7 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:09.207016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 753/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:10.027259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cae49-1919-43a9-8939-839ee3fb4ae0 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:10.027877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cae49-1919-43a9-8939-839ee3fb4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:10.027877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cae49-1919-43a9-8939-839ee3fb4ae0 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:10.029150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:10.034081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034d9-81bd-402c-a97f-768a7c4502e3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:10.034529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034d9-81bd-402c-a97f-768a7c4502e3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:10.034640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0034d9-81bd-402c-a97f-768a7c4502e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:10.053758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-af0034d9-81bd-402c-a97f-768a7c4502e3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:10.054985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af0034d9-81bd-402c-a97f-768a7c4502e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:10.063337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 10:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:10.215239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cae49-1919-43a9-8939-839ee3fb4ae0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:10.230099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cae49-1919-43a9-8939-839ee3fb4ae0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:10.235507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:10.236097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:10.236374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:10.236646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:10.244722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:10.246324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d9a9-d73b-47b9-8a7f-f5bfd5cc6b08 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:10.255592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 773/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:14.344350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.344983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.344983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.346262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:14.351537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301177-3cff-44ad-8853-6c79088897cf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.351984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301177-3cff-44ad-8853-6c79088897cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.352108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301177-3cff-44ad-8853-6c79088897cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.371849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dd301177-3cff-44ad-8853-6c79088897cf None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:14.373058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dd301177-3cff-44ad-8853-6c79088897cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.381180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:14.675852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:14.677591 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:14.755341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a183d1-3f6a-4b37-911e-7c31ac66731c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:14.759020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:14.759615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:14.759888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:14.760154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:14.769803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:14.771250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234a29-ef75-4a97-ac28-09556c825a15 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:14.781019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 756/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:16.736879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68a90-f8a9-456b-bfbf-50f752451668 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.737461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68a90-f8a9-456b-bfbf-50f752451668 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.737461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68a90-f8a9-456b-bfbf-50f752451668 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.738811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:16.744323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8c42-2235-48dd-8a53-f3393c8d6a25 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:16.744807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8c42-2235-48dd-8a53-f3393c8d6a25 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:16.744923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8c42-2235-48dd-8a53-f3393c8d6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:16.767092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8fdc8c42-2235-48dd-8a53-f3393c8d6a25 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:16.768412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8fdc8c42-2235-48dd-8a53-f3393c8d6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:16.777084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:17.065962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68a90-f8a9-456b-bfbf-50f752451668 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:17.078294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68a90-f8a9-456b-bfbf-50f752451668 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:17.081882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:17.082521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:17.082802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:17.083070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:17.092051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:17.093462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28707d5-43dc-4c1c-88d2-eb91a2ef5d7c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:17.102849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 776/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:20.790623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.791167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.791167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.792539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:20.797793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c731f-5154-4a4f-95b3-d13acbc2253f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:20.798231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c731f-5154-4a4f-95b3-d13acbc2253f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:20.798381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c731f-5154-4a4f-95b3-d13acbc2253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:20.817633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a46c731f-5154-4a4f-95b3-d13acbc2253f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:20.818866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a46c731f-5154-4a4f-95b3-d13acbc2253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:20.827179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:21.382266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:21.383942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:21.429780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:21.460446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10203ae-9aec-401c-8736-028e450c44cd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:21.463940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:21.464535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:21.464810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:21.465071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:21.473912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:21.475419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411767af-057d-4aea-a89d-96f8d2062fb1 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:21.485287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 759/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:23.434355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.436316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.436316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.436535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 10:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:41:23.442371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21078432-eba8-4199-b98b-61963b540664 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:23.442895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21078432-eba8-4199-b98b-61963b540664 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:23.442999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21078432-eba8-4199-b98b-61963b540664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:23.463039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-21078432-eba8-4199-b98b-61963b540664 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:41:23.464261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-21078432-eba8-4199-b98b-61963b540664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:23.472345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:41:24.072384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:41:24.074757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:41:24.083912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=77 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:24.091999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43534f7d-72e1-459a-b912-ced75bdde338 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:41:24.096063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:41:24.096780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:41:24.097059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:41:24.097330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:41:24.108629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:41:24.110238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63284c-2869-452c-b821-44491d2796ea service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:41:24.120990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 779/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:41:33.457972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=18 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:41:34.116506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:56.804747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:56.805410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:56.805410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:56.830122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:56.831358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:56.846178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 761/1540] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:56.856300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551d2b-92a0-478a-b1f2-5522a9180aaa None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:56.856876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551d2b-92a0-478a-b1f2-5522a9180aaa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:56.856876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68551d2b-92a0-478a-b1f2-5522a9180aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:56.899166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-68551d2b-92a0-478a-b1f2-5522a9180aaa None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:56.901347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-68551d2b-92a0-478a-b1f2-5522a9180aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:56.912637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 780/1541] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:56.917424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:56.926336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed253f-2b96-4d34-844f-ef4d0d013aa6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:56.926644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed253f-2b96-4d34-844f-ef4d0d013aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:56.926896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed253f-2b96-4d34-844f-ef4d0d013aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:56.933562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402836-d63f-4af3-844e-0b9f9458aec4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:56.943515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:56.944150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:56.944430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:56.944851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:56.945663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:56.945973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:56.948208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:56.965759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-deed253f-2b96-4d34-844f-ef4d0d013aa6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:56.966637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 762/1542] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:56.967156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-deed253f-2b96-4d34-844f-ef4d0d013aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:56.974976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:56.986084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fbcf-eb46-4850-ad37-b7c72e40ddf2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:56.992602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 781/1543] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:42:56.995541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:56.996169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:56.996451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:56.996726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:56.997364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.002925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:42:57.002925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:42:57.002925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:42:57.003681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75907-33c2-4f1b-b60a-7deaab7fa20e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.003968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75907-33c2-4f1b-b60a-7deaab7fa20e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.004246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75907-33c2-4f1b-b60a-7deaab7fa20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.004363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.034015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dff75907-33c2-4f1b-b60a-7deaab7fa20e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.035670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dff75907-33c2-4f1b-b60a-7deaab7fa20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.049991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 782/1544] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.051334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa00-d2a2-494f-8e99-5ad4ce81a156 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.051794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa00-d2a2-494f-8e99-5ad4ce81a156 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.052073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5aa00-d2a2-494f-8e99-5ad4ce81a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.071422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 763/1545] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:56 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.072795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.077655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8dc5aa00-d2a2-494f-8e99-5ad4ce81a156 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.079211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8dc5aa00-d2a2-494f-8e99-5ad4ce81a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.153951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 783/1546] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.154214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b880f-a4e7-4572-86e4-0fb1f06cca84 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.155241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.155554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.155789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.158963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.159573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.159855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.160124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.160777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.161075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.163027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb796f-38dd-4ff5-9f04-2b36e8b85adc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.176342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.176584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 764/1547] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.177566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.177693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209f4e-8d9a-4c76-924b-e6164f8e2d3f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.177908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209f4e-8d9a-4c76-924b-e6164f8e2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.178267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209f4e-8d9a-4c76-924b-e6164f8e2d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.191368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 784/1548] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.192163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.200830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-70209f4e-8d9a-4c76-924b-e6164f8e2d3f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.202053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-70209f4e-8d9a-4c76-924b-e6164f8e2d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.203735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc725f-ffd3-4231-bb7d-77e7d6f86f85 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.208391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.209019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.209295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.209571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.209960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 765/1549] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.210218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.211187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea55e4-7e61-4c60-a1bb-b42c324e3263 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.211336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:42:57.211336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:42:57.211336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:42:57.211546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea55e4-7e61-4c60-a1bb-b42c324e3263 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.211751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea55e4-7e61-4c60-a1bb-b42c324e3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.212417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a6459-a5b1-48da-9409-c4944d88d659 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.233103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ffea55e4-7e61-4c60-a1bb-b42c324e3263 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.234700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ffea55e4-7e61-4c60-a1bb-b42c324e3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.235954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 785/1550] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.237219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a468c2-045e-494c-85b2-650b71d9b3ef None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.237509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a468c2-045e-494c-85b2-650b71d9b3ef None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.237781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a468c2-045e-494c-85b2-650b71d9b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.245613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 766/1551] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.246879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.247156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.247420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.258764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-51a468c2-045e-494c-85b2-650b71d9b3ef None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.260841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-51a468c2-045e-494c-85b2-650b71d9b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.267334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.268524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.268827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 786/1552] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.270175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32e7e-cc44-4808-9ad7-1e78fde27265 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.270464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32e7e-cc44-4808-9ad7-1e78fde27265 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.270798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c32e7e-cc44-4808-9ad7-1e78fde27265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.276925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 767/1553] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.283307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.291049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e6c32e7e-cc44-4808-9ad7-1e78fde27265 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.292324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e6c32e7e-cc44-4808-9ad7-1e78fde27265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.294308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ab468-c151-40ea-9ef5-05e052315845 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.299268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.299879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.300161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.300297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 787/1554] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.300445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.301066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.301706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.301996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.302378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.303095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee6192-c9ec-4608-baf8-e906888f7872 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.323563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.324828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.332399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 768/1555] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.333464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 788/1556] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.333661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a70b-8ddd-499c-b964-e06d6b650116 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.333952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a70b-8ddd-499c-b964-e06d6b650116 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.334242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9a70b-8ddd-499c-b964-e06d6b650116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.334353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.344196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c075c-da45-455d-8fe3-d21bbe673f81 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.355968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a2a9a70b-8ddd-499c-b964-e06d6b650116 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.357192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a2a9a70b-8ddd-499c-b964-e06d6b650116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.402880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.403539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.403821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.404270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.404950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.406647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78445eda-6e10-4583-ae36-94a3eff59aa2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.416694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 789/1557] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:57.418049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071fd3-e325-4692-9a70-1814e94b17d0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.418359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071fd3-e325-4692-9a70-1814e94b17d0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.418635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8071fd3-e325-4692-9a70-1814e94b17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.421693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 769/1558] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.423019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.423309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.423586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.431104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.440126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a8071fd3-e325-4692-9a70-1814e94b17d0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.441345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a8071fd3-e325-4692-9a70-1814e94b17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.445084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.446340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.449799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 790/1559] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.451112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.451400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.451673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.458685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 770/1560] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.459621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.471186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:57.471522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d269a0-2f65-49dc-95a8-26832b9718d7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.472390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:57.476254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.476861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.477142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.477409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.478053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.478380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.480005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.480208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 791/1561] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:57.481133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.492442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 771/1562] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.492763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276da4a-4587-4856-91ca-6d7afd11e4e4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.493274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.498279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.498895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.499176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.499447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.500218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.502194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.505285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24fa53-bf03-450f-8f93-6e59168e13ba admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.510811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.511417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.511694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.511964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.512612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.512917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.514638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.526831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 792/1563] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.534658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 772/1564] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.534880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.534987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.535080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.538620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e350e1-209c-41df-bd45-1a2513c880af admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.544009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.544625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.544907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.545181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.545768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021546f-bd78-4a2d-9ea3-c0c9c538d6be admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.545889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.547454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.551089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.551714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.551995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.552267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.553373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.553825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.555472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.558579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 793/1565] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:57.559407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.575911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 773/1566] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.575911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.576179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e8720-a3b0-4d3d-8dfe-3bffc2b330b9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.576179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.576179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.576179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.576558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.576822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.577131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.578176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:42:57.578176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:42:57.578176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:42:57.579064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.579991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf44663-a4ab-4385-ad32-e86908bf0cbf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.584708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.585308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.585584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.585854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.586520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.586825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.588524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.598474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 794/1567] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.598474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.602315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45e5cd-b69f-4398-970b-2ab38ee53312 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.604647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 774/1568] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.612178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.612268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.612268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.612268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.612268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.612579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:42:57.612579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.612579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.616172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6bc8b-d785-40e8-96df-7a68c39dd18e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.621860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.622493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.622775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.623044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.623667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.624827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 795/1569] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:42:57.625642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.625753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.636078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52a347-facf-4066-8825-673aaf8fb076 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.640328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.640931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.641215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.641496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.642173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.643945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.652734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 775/1570] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.656066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.656961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 796/1571] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:57.657756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.668217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3b7c-d6e6-4143-bcf4-38e145daf1ae admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.718800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d55d8-dad9-422e-a6c9-901ee7ca2470 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.723939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.724536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.724808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.725070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.725440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.725693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.726141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.726438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.726707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] PATH_INFO: `/v3/projects/cab2f36b8f9344a5b393d94aa1c6069c/users/62e4da81d62c4350b81a6c72cd559462/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.727646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.742305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab2f36b8f9344a5b393d94aa1c6069c, user_id=62e4da81d62c4350b81a6c72cd559462, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.745636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.766128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 776/1572] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.766128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.768983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 797/1573] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:57 2022] PUT /identity/v3/projects/cab2f36b8f9344a5b393d94aa1c6069c/users/62e4da81d62c4350b81a6c72cd559462/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:57.769807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.829873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f769bff-0652-484f-bc23-1cca2d32a154 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.832320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6147c8-e772-462c-bcdc-7c18dfa0bb6b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.834652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.835265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.835545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.835820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.836441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.837556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.838424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.838521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.838607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.838831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.839461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.841356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.850254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.873857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 777/1574] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.873857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.877633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 798/1575] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:57.878303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:57.907689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:57.949229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657c19-e7e4-4548-867a-f745f2521287 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.959847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fe33-2e3f-47ff-9fb1-bf2e4de812b2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:57.964696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:57.965486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:57.965871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:57.966517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:57.967090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:57.969127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:57.999610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 799/1576] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.000465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.016477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.017128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.017409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.017681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.018385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.020360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.052088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 778/1577] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.052962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.067392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42c1d7-47bd-4587-b684-70fe18bbb2a8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.120865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ab9a-df33-4a04-960a-7eaf4bc854a9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.126032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.126689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.127028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.127253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.127902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.128014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.128523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.128804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.129103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.129570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.129786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.131765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e86e6-1ff7-49b8-8d95-2c0a3c50ca08 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.140372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 779/1578] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.141274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.152981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a282b9-8bc1-4110-bc94-9dc8c829356a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.158160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.158940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.159385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.159666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.160507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.162786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.168078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 800/1579] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:57 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.169463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.169787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.170106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.189528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 780/1580] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.189528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.193341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:58.194781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:58.196758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:58.197487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432e33-6eed-4c07-974c-2f7d394bbd35 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.203753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.204433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.204785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.205080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 801/1581] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:58.205201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.205865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.205990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.207921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.221843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de6f5-74ff-4009-a472-a27f65e4c696 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.227660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.228280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.229144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.229409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.230036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.232135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.232574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 781/1582] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.233202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.243174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee114ca8-cf95-4da2-9b8f-8d15c0a5e00f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.248634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.249488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.249839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.250229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.250916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.252928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.255365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 802/1583] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.256178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.268572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b7532-1648-48e0-b0bc-3dcd502d06e6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.273697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.274338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.274612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.274880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.278690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 782/1584] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.278832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.278916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.279032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.286421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d53334-b5a9-47b9-8e85-cfa0c9ef1fe6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.291980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.292665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.292893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.293164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] PATH_INFO: `/v3/projects/6e8de12b35964aa0a3c7ee3850a441eb/users/2d3337393d4142a280cd8e5957ea4ca5/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.300054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 803/1585] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/users => generated 279 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:58.301041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.306136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:58.311962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8de12b35964aa0a3c7ee3850a441eb, user_id=2d3337393d4142a280cd8e5957ea4ca5, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.312590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7be95-37f3-4c09-aa95-258299f66b00 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.313032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:42:58.313032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:42:58.313032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:42:58.315284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.318372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.319085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.319427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.319706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.320386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.321963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.328469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 783/1586] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/6e8de12b35964aa0a3c7ee3850a441eb/users/2d3337393d4142a280cd8e5957ea4ca5/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:58.329355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.335699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 804/1587] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.335699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.392825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253085d6-29c8-45fe-8b9e-d9cd05a04209 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.399773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb012e-d0fa-4a43-b598-9793c7a0dcb8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.405157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.405866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.406241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.406515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.407157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.408757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.423099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 784/1588] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.423099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.431668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75cdf-a9ad-4ae2-9d59-fc54c0af0639 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.436521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.437135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.437413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.437690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.438382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.439971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.444682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.445842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.446241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.446593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.450916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 785/1589] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.450916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.457044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.458588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.461418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbdd72-56e0-4ea7-b9cc-a2a10e1fa1e6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.466662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.467258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.467537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.467810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.468477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.468938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 805/1590] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:58.469756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.470093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.480072 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e5b8b-0420-4c23-9b42-f6cc248e2551 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.481835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 786/1591] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.482731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.485061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.485674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.485957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.486266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.487061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.488666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.493418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffc295-7598-43ad-ac88-23bb6336ff9b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.499366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 806/1592] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.499671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.500338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.500481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.500669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.500856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.501499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.503342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2afc-62ef-4c12-a4dd-b77812e06900 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.514516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec4b94-cfa6-4a3f-b08a-d221497e407e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.515225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 787/1593] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.516392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.516731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.516962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.522553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.523179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.523462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.523735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.524412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.527146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.540848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 807/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.540848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.552029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] MFA Rules not processed for user `2d3337393d4142a280cd8e5957ea4ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:58.552426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b2a07-ea79-4a42-b41e-53b010cb27ef admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.553595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:58.558033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.558702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.558980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.559263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.560063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.561860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.575121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 808/1595] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.575999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.587321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9c1d4-37b9-4f83-b004-2099de6cd18c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.592838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.593459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.593859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.594169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.594940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.596560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.607972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 809/1596] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.608954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.621369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:58.622807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46139fa5-c529-4c18-84ba-0e0b0dd10753 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.631440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.632152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.632437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.633195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.633513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 788/1597] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:58.633823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.636612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.639208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.652139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0fc2b-29c2-4f50-8c20-6b8b71519875 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.655781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 810/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.655781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.661811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.662514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.662792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.663061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.664271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.665609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.668675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6733d-69d0-434f-8a3b-3ac179b99793 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.674579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.675211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.675497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.675821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.676660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.680899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 789/1599] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.680899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.681136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.690699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dee09-c546-4288-a5e1-3ec786f89ae0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.692787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 811/1600] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:42:58.693705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.699562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.700251 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.700531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.700812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] PATH_INFO: `/v3/projects/5744a6e833cf41cb9c866f2ae12e73af/users/b19867381459418fb5286733a88fe32a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.713929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00778-a0c4-4a03-8def-c70baae81dff admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.721153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.722232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.722516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.722864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744a6e833cf41cb9c866f2ae12e73af, user_id=b19867381459418fb5286733a88fe32a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.723002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] PATH_INFO: `/v3/projects/e140b734ec2a4f6598bbdd2ef70584b4/users/ba9ad96c6092431abc7b474ac7a26cc4/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.725782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.740699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e140b734ec2a4f6598bbdd2ef70584b4, user_id=ba9ad96c6092431abc7b474ac7a26cc4, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.741175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 790/1601] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/5744a6e833cf41cb9c866f2ae12e73af/users/b19867381459418fb5286733a88fe32a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:58.741996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.745401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.767393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 812/1602] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/e140b734ec2a4f6598bbdd2ef70584b4/users/ba9ad96c6092431abc7b474ac7a26cc4/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:58.768344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.793892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:58.829564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b31c-784d-45fa-8ded-2506d8ed2382 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.845581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5008a3-43da-4e0f-9e07-4feb2b5dc9a7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:58.862013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.863857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.864589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.865093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.901061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:58.901645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:58.901921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:58.902239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] PATH_INFO: `/v3/projects/21826a9842354f1db4a8b0d57980e31a/users/9699204c95f540a5bedfd85220def3da/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:58.919693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=21826a9842354f1db4a8b0d57980e31a, user_id=9699204c95f540a5bedfd85220def3da, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.922461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.942272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 791/1603] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/21826a9842354f1db4a8b0d57980e31a/users/9699204c95f540a5bedfd85220def3da/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:58.942272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.955913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:58.957703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:58.971749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 813/1604] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:58.972858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:58.985699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d76f5-9588-4c88-9345-b7f5e6abbcb5 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.009476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:59.024253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9689-21f8-4831-aba0-17912da3e0be admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.030963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.031630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.031906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.032180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] PATH_INFO: `/v3/projects/53e787dbbd234a98950197aea08d22a0/users/3fa949de246545a483c8e81207bf81d8/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.050668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e787dbbd234a98950197aea08d22a0, user_id=3fa949de246545a483c8e81207bf81d8, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.053610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.060763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.061615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.061931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.062357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] PATH_INFO: `/v3/projects/1a17920469b64c2ab4e298adf4dfeea9/users/05e7e4f3fe0b41f0a074adfe14b027e5/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.077164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 792/1605] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/53e787dbbd234a98950197aea08d22a0/users/3fa949de246545a483c8e81207bf81d8/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:59.078564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:59.083843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a17920469b64c2ab4e298adf4dfeea9, user_id=05e7e4f3fe0b41f0a074adfe14b027e5, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.089461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c573f36-f7f8-4347-99ed-5057d83b7b0f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.118766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 814/1606] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:58 2022] PUT /identity/v3/projects/1a17920469b64c2ab4e298adf4dfeea9/users/05e7e4f3fe0b41f0a074adfe14b027e5/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:59.120562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e820d1-6e51-415b-9289-2cc5f89f155c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.122459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e820d1-6e51-415b-9289-2cc5f89f155c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.123105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e820d1-6e51-415b-9289-2cc5f89f155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.168953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e5e820d1-6e51-415b-9289-2cc5f89f155c None None] MFA Rules not processed for user `b19867381459418fb5286733a88fe32a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.170972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5e820d1-6e51-415b-9289-2cc5f89f155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.174442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d8b7-85b0-413d-8bfe-b9903f58d93e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.244859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:59.278213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 815/1607] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.279924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b320f-e169-41b1-a4e8-c68ba516820c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.280361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b320f-e169-41b1-a4e8-c68ba516820c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.280950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b320f-e169-41b1-a4e8-c68ba516820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.288178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.288906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.290152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.290596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] PATH_INFO: `/v3/projects/163b984262a8462eb480f641eb5a8ea6/users/fc6b45f7748e4f6f95b6389b77dbddf5/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.319358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8c9b320f-e169-41b1-a4e8-c68ba516820c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.320912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8c9b320f-e169-41b1-a4e8-c68ba516820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.333810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163b984262a8462eb480f641eb5a8ea6, user_id=fc6b45f7748e4f6f95b6389b77dbddf5, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.335752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 816/1608] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.336706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2426b-ba0e-449e-83ed-e42a11402a95 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.337212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.337492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.337829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.359745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 793/1609] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:42:59 2022] PUT /identity/v3/projects/163b984262a8462eb480f641eb5a8ea6/users/fc6b45f7748e4f6f95b6389b77dbddf5/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:42:59.361117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8c5e-49ec-4b11-9dee-d441be46db70 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.361411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8c5e-49ec-4b11-9dee-d441be46db70 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.361725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b8c5e-49ec-4b11-9dee-d441be46db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.386923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-263b8c5e-49ec-4b11-9dee-d441be46db70 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.388178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-263b8c5e-49ec-4b11-9dee-d441be46db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.414234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] MFA Rules not processed for user `9699204c95f540a5bedfd85220def3da`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.416270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.469675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 794/1610] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.471090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.471378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.471652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.480453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:59.508176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] MFA Rules not processed for user `05e7e4f3fe0b41f0a074adfe14b027e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.510751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.556112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 817/1611] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.557456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:59.569826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63836b1c-1afd-4bd5-9064-f32c832c5b8d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.584332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.585193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.585421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.585696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.586366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.588732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50282518-a215-4145-a368-fe72cdeacb7f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.636392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 795/1612] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.638355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:59.682954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 818/1613] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:42:59.689446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.696868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.698991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.712608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68d14-1712-43d0-9aff-2bad69e833be None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.748127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] MFA Rules not processed for user `fc6b45f7748e4f6f95b6389b77dbddf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:42:59.749818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:42:59.847519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.848141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.848414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.848677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.855576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 819/1614] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:42:59.855576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:42:59.883939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e605ff-a5ff-463d-9780-5de1831510ee None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:42:59.896253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:42:59.896893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.897311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.897613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.962368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:42:59.965561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9633c-d848-41a4-868a-05462affce45 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:42:59.972329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:59.979823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:42:59.984580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 796/1615] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:42:59.986573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b6d4-bbee-45d4-9462-922f21a363b8 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.987068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b6d4-bbee-45d4-9462-922f21a363b8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.987452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973b6d4-bbee-45d4-9462-922f21a363b8 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.989303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 797/1616] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 24 10:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:42:59.992631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713be12c-a1b1-41d6-aa7c-ebf327f9eba1 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:42:59.992815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713be12c-a1b1-41d6-aa7c-ebf327f9eba1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:42:59.993234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713be12c-a1b1-41d6-aa7c-ebf327f9eba1 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:42:59.998110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 798/1617] 10.222.0.52 () {54 vars in 962 bytes} [Wed Aug 24 10:42:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:42:59.998991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713be12c-a1b1-41d6-aa7c-ebf327f9eba1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.017579 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713be12c-a1b1-41d6-aa7c-ebf327f9eba1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.019326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.021139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.023010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.023188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.023473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.023750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.024468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.027161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b62a0-a954-41be-a908-f8cb8840f86b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.036488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 820/1618] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:00.037846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.051742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5ab2-503e-45ca-8468-aab0a60becb1 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.057355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 799/1619] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:42:59 2022] POST /identity/v3/users => generated 296 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:00.057355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.057355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.057775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.058532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.059373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.059806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.060204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.061237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.063379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a176b-083a-4bce-a18c-ca5235e47c21 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.111065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:00.112363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 821/1620] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:00 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:00.113966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.114326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.114750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.116590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:00.143678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:00.145157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:00.197585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 800/1621] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 24 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:00.198760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.265604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 822/1622] 10.222.0.52 () {58 vars in 1059 bytes} [Wed Aug 24 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:00.274151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.296835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af17a3-49f4-4381-9216-e07fe90c08f7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.311355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.312340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.312944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.313387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.314772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.317519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.334883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 801/1623] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:00.334883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.354234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a92e72-c1b4-4254-b304-9db34705fc7e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.362862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.363977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.364446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.364718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.442164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c439f-2bb3-4e67-aa59-cc03fc47e5ac None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.448142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.450006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.450601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.450950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.452309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.455021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.462234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:00.468424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.471429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.500267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 823/1624] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:00 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:00.500470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 802/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:00.500470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.513084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.516824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488a536-769f-4784-890c-4e224f5b958f service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.522492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.523332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.523722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.524256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] PATH_INFO: `/v3/projects/de8bfb58f8f844debab57c7c6113bf6c/users/75220c5184bc491d9e9d00272a5d6d90/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.541194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173098f-369b-46a3-b58b-d69422df0f20 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.549644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8bfb58f8f844debab57c7c6113bf6c, user_id=75220c5184bc491d9e9d00272a5d6d90, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.550393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.551271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.552065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.552545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.555071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.579200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 803/1626] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:00 2022] PUT /identity/v3/projects/de8bfb58f8f844debab57c7c6113bf6c/users/75220c5184bc491d9e9d00272a5d6d90/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:00.582339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.677774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:00.740267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.745082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.807584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 824/1627] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:00.811754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.816572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6f55d-a253-4947-bde6-efb66243b4e5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.827141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.827975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.828300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.828577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.832879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.835331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.865542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 804/1628] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:00.873749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:00.882952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7453-60c4-4245-89d8-44f317381caa service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.902458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.902722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.908206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.908206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.908206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.914914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089011a-cee4-4517-bf40-7d40b63bbc8a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:00.917840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882a205-5cb3-4908-93fc-22c5d56d7d11 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.927906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:00.932151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.934550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.935738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] PATH_INFO: `/v3/projects/990f2888565b4afc946ec465688f31d0/users/400ce235983a408ebc3928e20aa22984/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.963442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990f2888565b4afc946ec465688f31d0, user_id=400ce235983a408ebc3928e20aa22984, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:00.967203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e544ed-2c29-4037-9f67-6e4bf6d6e772 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:00.975273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 825/1629] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:00.977238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c1101-868c-4cdb-bfa0-85d821c4fc10 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:00.977671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c1101-868c-4cdb-bfa0-85d821c4fc10 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:00.978010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c1101-868c-4cdb-bfa0-85d821c4fc10 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:00.988348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 826/1630] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 24 10:43:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:00.989560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c1101-868c-4cdb-bfa0-85d821c4fc10 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:01.008650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 805/1631] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:00 2022] PUT /identity/v3/projects/990f2888565b4afc946ec465688f31d0/users/400ce235983a408ebc3928e20aa22984/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:01.012699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c5c2-9ca0-45b0-81fc-da6983fb7649 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.013077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c5c2-9ca0-45b0-81fc-da6983fb7649 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.013680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327c5c2-9ca0-45b0-81fc-da6983fb7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.056895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5327c5c2-9ca0-45b0-81fc-da6983fb7649 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:01.061059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5327c5c2-9ca0-45b0-81fc-da6983fb7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:01.155273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c1101-868c-4cdb-bfa0-85d821c4fc10 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:01.177716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:01.180314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.181051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.181051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] PATH_INFO: `/v3/projects/de8bfb58f8f844debab57c7c6113bf6c/users/75220c5184bc491d9e9d00272a5d6d90/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.184162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8bfb58f8f844debab57c7c6113bf6c, user_id=75220c5184bc491d9e9d00272a5d6d90, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:01.192575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:01.222499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 827/1632] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:00 2022] PUT /identity/v3/projects/de8bfb58f8f844debab57c7c6113bf6c/users/75220c5184bc491d9e9d00272a5d6d90/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:01.224856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:01.257371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 806/1633] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:01.259320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.260396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.261290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.339715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475946-e590-4f63-84ef-1a7abd9b59c9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:01.344848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] MFA Rules not processed for user `75220c5184bc491d9e9d00272a5d6d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:01.345913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:01.346771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.347125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.348043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:01.348164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.349065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:01.350795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:01.366723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 828/1634] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:01.366723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:01.407760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:01.440733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:01.448008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb6380-2b19-4173-abdc-70e3ea6de5dd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:01.454531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:01.455501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.455902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.456535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.516350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 807/1635] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:01.517253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:01.550881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f21dc-205b-4447-a6ee-f1086d75db1b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:01.567955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:01.568900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.569168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.569267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] PATH_INFO: `/v3/projects/990f2888565b4afc946ec465688f31d0/users/400ce235983a408ebc3928e20aa22984/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.571438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990f2888565b4afc946ec465688f31d0, user_id=400ce235983a408ebc3928e20aa22984, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:01.574947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63eb4b-4bd0-4b1c-a759-73a1ed998192 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:01.594294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:01.596993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:01.619265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 808/1636] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:01 2022] PUT /identity/v3/projects/990f2888565b4afc946ec465688f31d0/users/400ce235983a408ebc3928e20aa22984/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:01.620771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7afdec-d600-4945-8fd7-8ca2d678dbfe None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.621060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7afdec-d600-4945-8fd7-8ca2d678dbfe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.621333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7afdec-d600-4945-8fd7-8ca2d678dbfe None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.624447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 829/1637] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:01.628582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:01.635973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 809/1638] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 24 10:43:01 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:01.637681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649749bd-822b-4c9e-a7c4-c63172aba3de None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.640381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649749bd-822b-4c9e-a7c4-c63172aba3de None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.640772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649749bd-822b-4c9e-a7c4-c63172aba3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.656917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec63d17-a7d7-4444-87ae-7845c0475c96 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:01.742146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-649749bd-822b-4c9e-a7c4-c63172aba3de None None] MFA Rules not processed for user `400ce235983a408ebc3928e20aa22984`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:01.743388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-649749bd-822b-4c9e-a7c4-c63172aba3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:01.789238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:01.789898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.790210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.790489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.965069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 810/1639] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:01.967912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:01.969718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:01.970287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:01.992776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:01.995847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:01.996200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:01.997807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:02.040095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 830/1640] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:02.101075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 811/1641] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:02.184628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:02.196578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81c789-91d5-49a5-bfaf-7d95e963678c service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:02.202014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:02.202938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.203404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.203853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.216993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:02.219098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:02.246117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 831/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:02.398514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:02.412560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec1cc-8ada-4f78-b093-2a7802c910b0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:02.421672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:02.422404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.422684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.422954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.448163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:02.449977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:02.483077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 812/1643] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:02.688203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:02.812604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:02.918911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:02.937455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dd253-2108-4d37-9945-28e1ffe28cb4 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:02.939773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb32b9-3843-4e96-8eb8-5b165cddca83 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:02.949067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:02.949700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.950027 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.950337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.960946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:02.960946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:02.960946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:02.960946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] PATH_INFO: `/v3/users/9699204c95f540a5bedfd85220def3da` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:02.962278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9699204c95f540a5bedfd85220def3da)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:02.964392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:02.966860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:03.084118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:03.092220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138231bf-f545-49c0-b662-132aec663fff service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:03.102863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9699204c95f540a5bedfd85220def3da'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:03.127564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9699204c95f540a5bedfd85220def3da'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:03.130458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 813/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:03.145779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9699204c95f540a5bedfd85220def3da'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:03.146627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9699204c95f540a5bedfd85220def3da'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:03.157238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9699204c95f540a5bedfd85220def3da'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:03.173064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 832/1645] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:02 2022] DELETE /identity/v3/users/9699204c95f540a5bedfd85220def3da => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:03.177417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:03.177847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:03.178392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:03.230310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:03.233678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:03.242674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:03.245209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:03.395269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc138-db08-453c-9303-46ddcb68e3a7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:03.411210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:03.416439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:03.417079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:03.417673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:03.426116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 814/1646] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:03.426274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:03.447245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:03.451323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:03.574356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:03.575958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:03.586160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:03.604627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 833/1647] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:03.623515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb768a-4bae-4068-b550-1659de236a96 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:03.641166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:03.641802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:03.642099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:03.642373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:03.665293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:03.666810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79f23c-4698-48a7-9464-e7ebf74e5875 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:03.689783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 815/1648] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:07.012542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:07.014441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:07.054992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2a279-fa84-4378-9299-7d3095974186 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:07.084498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:07.085178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.085617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.085905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] PATH_INFO: `/v3/projects/21826a9842354f1db4a8b0d57980e31a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.087897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21826a9842354f1db4a8b0d57980e31a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:07.088955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:43:07.088955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 24 10:43:07.088955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: Aug 24 10:43:07.095018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:07.368194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21826a9842354f1db4a8b0d57980e31a', 'request_id': 'req-e479e641-3f77-487b-b3e5-3a697f4965d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:07.401264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21826a9842354f1db4a8b0d57980e31a', 'request_id': 'req-e479e641-3f77-487b-b3e5-3a697f4965d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:07.422886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21826a9842354f1db4a8b0d57980e31a', 'request_id': 'req-e479e641-3f77-487b-b3e5-3a697f4965d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:07.472166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] The token cache is being invalidate because project 21826a9842354f1db4a8b0d57980e31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:07.472465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:07.476426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e479e641-3f77-487b-b3e5-3a697f4965d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:07.481711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 834/1649] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:07 2022] DELETE /identity/v3/projects/21826a9842354f1db4a8b0d57980e31a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:07.486419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7a1fb-a544-44c4-baa8-9b395862d612 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.486996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7a1fb-a544-44c4-baa8-9b395862d612 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.486996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7a1fb-a544-44c4-baa8-9b395862d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.552931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b5d7a1fb-a544-44c4-baa8-9b395862d612 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:07.554227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b5d7a1fb-a544-44c4-baa8-9b395862d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:07.592435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4f24-48fa-4f0c-a378-a2fc4f453ea8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.593154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4f24-48fa-4f0c-a378-a2fc4f453ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.593854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4f24-48fa-4f0c-a378-a2fc4f453ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.679380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-aaba4f24-48fa-4f0c-a378-a2fc4f453ea8 None None] MFA Rules not processed for user `62e4da81d62c4350b81a6c72cd559462`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:07.683408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-aaba4f24-48fa-4f0c-a378-a2fc4f453ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:07.685832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:07.722896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 816/1650] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:07.732458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.733078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.734197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.770917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:07.772735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:07.786847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 817/1651] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:07.790501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:07.804726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c17d77-5546-4a37-a628-7ef0e67073d5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:07.824865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:07.829215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.829625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.829990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.831054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:07.846246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:07.846246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:07.846622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 835/1652] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:07.856925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.865923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 818/1653] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:07.870728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:07.871532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.871868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.904324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a22a7-a2e7-4b82-8c85-b3d10862d0bd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:07.912439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:07.914561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:07.914843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:07.915119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:07.917964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:07.926794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:07.940874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] MFA Rules not processed for user `62e4da81d62c4350b81a6c72cd559462`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:07.942051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:07.975078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 836/1654] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:08.002285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 819/1655] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:07 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:08.006406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.021506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6895c4-43ce-4837-a787-7394b9253158 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:08.109915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:08.111614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.112052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.112488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.113812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:08.116723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:08.131423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:08.150629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 837/1656] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:08 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:08.155029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.181912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.187641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:08.189926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8c5d-a779-4235-9c07-6954496d2330 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:08.211476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:08.212156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.212487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.212747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.232076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:08.234062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:08.292753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 820/1657] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:08.297232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.345805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563eec0-47c9-4e6b-934a-f773d6c62a2d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:08.377686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:08.380615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.382355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.387181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.389274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:08.393784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:08.459458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 821/1658] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:08.466156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.518773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362324b-706e-4106-8967-0ed79fdb38f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:08.547451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:08.548142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.548424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.548881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] PATH_INFO: `/v3/projects/5aa4a0bec4584dcc9b7c2ba2b698902d/users/98a0eafb8b824d2eb3640c1377cbacf8/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.588781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8ff0-af2e-4251-ab4e-837db244cac1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:08.622717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa4a0bec4584dcc9b7c2ba2b698902d, user_id=98a0eafb8b824d2eb3640c1377cbacf8, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:08.625712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29289ff-7571-442f-b58a-27ad0f11f9f6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:08.629657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:08.631421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.631708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.631990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.675241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 822/1659] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:08 2022] PUT /identity/v3/projects/5aa4a0bec4584dcc9b7c2ba2b698902d/users/98a0eafb8b824d2eb3640c1377cbacf8/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:08.694556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:08.694556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:08.694808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:08.756795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] MFA Rules not processed for user `98a0eafb8b824d2eb3640c1377cbacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:08.758331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:08.860106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:08.862670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:08.894536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 838/1660] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:08.918930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 823/1661] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:08.923036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:08.948238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a01e-5315-4775-ba95-2965acc51482 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.091910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.092660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.093040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.093653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.094340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.097382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.180680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 839/1662] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:08 2022] POST /identity/v3/projects => generated 393 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:09.186136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:09.215495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b66d13-eb22-403c-aff8-bf09dfb32381 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.404241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:09.423111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.423920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.424035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.424815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.424969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.428273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.475482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 824/1663] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:09 2022] POST /identity/v3/users => generated 303 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:09.476600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:09.495248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79aa28-2b7c-4130-82cd-4789ec7aaf96 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.504074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.505055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.505536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.506195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.507058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.508988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.528352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 840/1664] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:09.532736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:09.549614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354687f-5fd2-4298-a366-c28acb7edd6e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.564969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.565591 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.565876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.566200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] PATH_INFO: `/v3/projects/3011778f19154622a893508a5363eab9/users/45de5f5f90ab42c2a69567d9fc4e125f/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.604441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3011778f19154622a893508a5363eab9, user_id=45de5f5f90ab42c2a69567d9fc4e125f, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.607614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.637585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 825/1665] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:09 2022] PUT /identity/v3/projects/3011778f19154622a893508a5363eab9/users/45de5f5f90ab42c2a69567d9fc4e125f/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:09.643768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:09.664549 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6143be7-a24d-40e0-b55b-31abf6bd4a1f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.682506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:09.865165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.865943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.866218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.866494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.868926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.872761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942cd7-61af-4d3f-bcef-e7d769913c22 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.906425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 841/1666] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:09.906514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:09.926723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff8c25-72b5-4c4c-a5d9-d14455f6e30a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:09.938055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:09.939503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.940055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.942241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] PATH_INFO: `/v3/projects/3011778f19154622a893508a5363eab9/users/45de5f5f90ab42c2a69567d9fc4e125f/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:09.945561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3011778f19154622a893508a5363eab9, user_id=45de5f5f90ab42c2a69567d9fc4e125f, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:09.950620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2da01-c27a-4148-82d9-576559ff1cf7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:09.977893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 826/1667] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:09 2022] PUT /identity/v3/projects/3011778f19154622a893508a5363eab9/users/45de5f5f90ab42c2a69567d9fc4e125f/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:09.993130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:09.993416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:09.994318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.082810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] MFA Rules not processed for user `45de5f5f90ab42c2a69567d9fc4e125f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:10.084856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:10.131921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116d7b-23d8-49f9-b802-0100b60aded4 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.133309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116d7b-23d8-49f9-b802-0100b60aded4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.135246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd116d7b-23d8-49f9-b802-0100b60aded4 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.137541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 827/1668] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 24 10:43:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:10.148501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.149084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.149535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.250460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:10.252689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:10.267448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 842/1669] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:10.282951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:10.284997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:10.411965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40f6e3-fa14-4049-a61f-96ce4f297561 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:10.423011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:10.424098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.424674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.425116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.453549 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:10.457629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:10.467064 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 828/1670] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:10.485922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 843/1671] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:10.574914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:10.577411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:10.601560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e123f-0a3f-4371-825e-ddc0287a7442 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:10.618697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:10.624243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.624534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.625074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.658889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:10.659295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:10.671602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218533b-cd47-48b1-9d2d-7dd47cc12257 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:10.673236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e22a8-1223-4bf4-9825-01c6093a9fe1 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:10.677703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:10.679185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:10.680108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:10.680632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:10.698505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 829/1672] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:10.764489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:10.804958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:10.808234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438335a2-9e95-41ab-8cec-da03b0565496 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:10.860689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 844/1673] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:11.779585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:11.780599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:11.781051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:11.782927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 830/1674] 10.222.0.52 () {54 vars in 961 bytes} [Wed Aug 24 10:43:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:11.788889 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926f31-9bf9-4efb-8616-8d38c732e183 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:11.789931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926f31-9bf9-4efb-8616-8d38c732e183 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:11.791090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926f31-9bf9-4efb-8616-8d38c732e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:11.833207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-95926f31-9bf9-4efb-8616-8d38c732e183 None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:11.834617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-95926f31-9bf9-4efb-8616-8d38c732e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:11.881703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:11.883673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:12.061849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 845/1675] 10.222.0.52 () {58 vars in 1058 bytes} [Wed Aug 24 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:12.066840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:12.068180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:12.069672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:12.085174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1f35-26bf-450e-b2f4-352b19ee8de0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:12.126561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:12.127844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:12.128292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:12.128810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] PATH_INFO: `/v3/users/05e7e4f3fe0b41f0a074adfe14b027e5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:12.130204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e7e4f3fe0b41f0a074adfe14b027e5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:12.131326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: WARNING py.warnings [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 10:43:12.131326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: warnings.warn(msg) Aug 24 10:43:12.131326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: Aug 24 10:43:12.132556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:12.148185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] MFA Rules not processed for user `62e4da81d62c4350b81a6c72cd559462`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:12.163833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:12.299897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:12.357986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e7e4f3fe0b41f0a074adfe14b027e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:12.427714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 846/1676] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:12.430483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:12.460931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e7e4f3fe0b41f0a074adfe14b027e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:12.462931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34c38-168c-48e7-a974-997b83a5ec82 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:12.474010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:12.475125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:12.475653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:12.476011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:12.478944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:12.491062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e7e4f3fe0b41f0a074adfe14b027e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:12.493118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e7e4f3fe0b41f0a074adfe14b027e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:12.500850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:12.504757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:12.514149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1a879307-9bd7-4273-b127-5de5a67b7d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e7e4f3fe0b41f0a074adfe14b027e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:12.536779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 831/1677] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:11 2022] DELETE /identity/v3/users/05e7e4f3fe0b41f0a074adfe14b027e5 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:12.542704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0512-0a84-4b09-9c2c-38466835c8c9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:12.543267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0512-0a84-4b09-9c2c-38466835c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:12.543741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0512-0a84-4b09-9c2c-38466835c8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:12.577104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 847/1678] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:12.592497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-749c0512-0a84-4b09-9c2c-38466835c8c9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:12.594560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-749c0512-0a84-4b09-9c2c-38466835c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:12.782939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 832/1679] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:12.822413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:12.848011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c515ee-2a17-448f-93a4-98026ec6fe53 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:12.906763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536fd4-a372-48f2-846f-917fe52e8af7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:12.907098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536fd4-a372-48f2-846f-917fe52e8af7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:12.907378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536fd4-a372-48f2-846f-917fe52e8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.002421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-19536fd4-a372-48f2-846f-917fe52e8af7 None None] MFA Rules not processed for user `3fa949de246545a483c8e81207bf81d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:13.010378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-19536fd4-a372-48f2-846f-917fe52e8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.015898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:13.023328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.027443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.029613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.094418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:13.108700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc973d6b-65d7-4951-8e4b-fe60057c5a25 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:13.133091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:13.176999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 848/1680] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:13.184633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.187490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.187773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.302365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 833/1681] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:13.312878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] MFA Rules not processed for user `ba9ad96c6092431abc7b474ac7a26cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:13.313770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.314087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.320350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.320633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.371512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] MFA Rules not processed for user `3fa949de246545a483c8e81207bf81d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:13.376341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.404482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 834/1682] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:13.421544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:13.423912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.511046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:13.567266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442557b4-3026-490d-a7bb-40f3c204ed1b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:13.575100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:13.578498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.579110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.579572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.590367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:13.592199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14837b-1045-438c-b4ac-4591de86f241 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:13.603767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 835/1683] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:13.606745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bef1-b8a6-4c9b-8987-f2290a519ff3 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.607033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bef1-b8a6-4c9b-8987-f2290a519ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.607434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102bef1-b8a6-4c9b-8987-f2290a519ff3 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.609070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 836/1684] 10.222.0.52 () {54 vars in 912 bytes} [Wed Aug 24 10:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:13.616263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 849/1685] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:13.618372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.619872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.622522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.691947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:13.703472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.749188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 837/1686] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:13.838279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:13.839801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:13.865398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e02bb-4c0a-4029-8bfb-6fec15f2a2b3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:13.888451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:13.889503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:13.889760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:13.890037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:13.919418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:13.921020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:13.968048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 850/1687] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:14.129997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:14.131467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:14.163721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf825064-53e1-43c8-aead-b14466f91ca3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:14.177089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:14.177653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:14.180103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:14.180729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] PATH_INFO: `/v3/projects/1a17920469b64c2ab4e298adf4dfeea9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:14.185380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a17920469b64c2ab4e298adf4dfeea9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:14.189704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:14.360259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:14.361704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:14.362548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a17920469b64c2ab4e298adf4dfeea9', 'request_id': 'req-e66a6fb6-4559-45b3-b740-72f3eca3228a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.378707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a17920469b64c2ab4e298adf4dfeea9', 'request_id': 'req-e66a6fb6-4559-45b3-b740-72f3eca3228a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.408522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536782-6163-450a-b4f7-844838fa91f5 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:14.419501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a17920469b64c2ab4e298adf4dfeea9', 'request_id': 'req-e66a6fb6-4559-45b3-b740-72f3eca3228a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.440213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] The token cache is being invalidate because project 1a17920469b64c2ab4e298adf4dfeea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:14.441089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.442601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e66a6fb6-4559-45b3-b740-72f3eca3228a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.451228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 838/1688] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:14 2022] DELETE /identity/v3/projects/1a17920469b64c2ab4e298adf4dfeea9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:14.454464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:14.454999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:14.459256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:14.505377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:14.507014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:14.599054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:14.599807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:14.600090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:14.600367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] PATH_INFO: `/v3/users/b19867381459418fb5286733a88fe32a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:14.601756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19867381459418fb5286733a88fe32a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:14.604860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:14.687846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 839/1689] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:14.690223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:14.692634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:14.700521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19867381459418fb5286733a88fe32a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.716282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19867381459418fb5286733a88fe32a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.732363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4ba9d-05e9-4d49-8f70-0ec66040589e None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:14.750819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:14.751160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19867381459418fb5286733a88fe32a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.751763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:14.752058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:14.752303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19867381459418fb5286733a88fe32a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.752409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] PATH_INFO: `/v3/users/2d3337393d4142a280cd8e5957ea4ca5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:14.754445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3337393d4142a280cd8e5957ea4ca5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:14.756568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:14.757714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:14.795407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-813923eb-0111-41a1-9104-5f3000b15c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19867381459418fb5286733a88fe32a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.822035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 851/1690] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:14 2022] DELETE /identity/v3/users/b19867381459418fb5286733a88fe32a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:14.826343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebffc3-1f00-4cb8-9c9f-174b19d99dfb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:14.828388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebffc3-1f00-4cb8-9c9f-174b19d99dfb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:14.830774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebffc3-1f00-4cb8-9c9f-174b19d99dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:14.855117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:14.892462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-17ebffc3-1f00-4cb8-9c9f-174b19d99dfb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:14.893693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-17ebffc3-1f00-4cb8-9c9f-174b19d99dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:14.901961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3337393d4142a280cd8e5957ea4ca5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.959906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3337393d4142a280cd8e5957ea4ca5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.995368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3337393d4142a280cd8e5957ea4ca5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:14.997659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3337393d4142a280cd8e5957ea4ca5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:15.026629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 852/1691] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:15.029010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3337393d4142a280cd8e5957ea4ca5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:15.030229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.030618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.030906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.055292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 840/1692] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:14 2022] DELETE /identity/v3/users/2d3337393d4142a280cd8e5957ea4ca5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:15.057790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.073995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:15.078339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.283482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 853/1693] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:15.285738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.288209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.292293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fbb89-2dbf-4db4-8696-d4e14463232c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:15.304092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:15.318846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.319377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.334786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.336678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:15.339242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:15.344256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26227e1-9141-4937-b29b-37ef32d80b88 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:15.378198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 841/1694] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:15.379883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.380403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.382220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.425618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:15.427429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.436808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 842/1695] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:15.438297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.440202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.540190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c356e1-5682-4342-bc5c-eced546ee066 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:15.565304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f43189-6f47-4400-89c1-c92e991ba991 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:15.571424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:15.573003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.573299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.580943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.595555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.611366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:15.615236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.616455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.617711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.669781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:15.671328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:15.704320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 843/1696] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:15.705291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.742689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:15.744962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d52cc-ac35-4b28-ad93-88b4e18ed410 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:15.765597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:15.766268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:15.766555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:15.766827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:15.767470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:15.776596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:15.812756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:15.820489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:15.852443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 854/1697] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:15.872820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.876821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:15.891057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 844/1698] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:15 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:15.897305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:15.926263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322642-2d0e-49df-a28f-56bede3d324d service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:15.943394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:16.102636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.104082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.104370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.105346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.136193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c78e-755a-4fd0-ae0c-cc06f158d24c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.144503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.145695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.146277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.146779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.148236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.153055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.192590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 845/1699] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:15 2022] POST /identity/v3/users => generated 282 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:16.194326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.211023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819d0f-884f-4d77-8409-8d84dbed48fd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.218292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.219307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.219728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.220331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.221414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.224128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.241004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 846/1700] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:16.247001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.264495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cae16-166f-4886-81eb-d7f43603daf6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.272612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.273296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.273577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.273849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.274681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.277668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.299298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 847/1701] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:16.300472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.314863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569cab0-76d1-4ba2-954a-ddd86f8a8dec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.320799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.322944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.323225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.323540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] PATH_INFO: `/v3/projects/aa494837caec44dd9e5ff2554fc6648c/users/4df9d4caa3b341e8853fba400440cd7a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.347114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa494837caec44dd9e5ff2554fc6648c, user_id=4df9d4caa3b341e8853fba400440cd7a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.350958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba078ce-a5b1-4e93-a761-e85ea26beaf2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.368229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.372528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.393673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 848/1702] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:16 2022] PUT /identity/v3/projects/aa494837caec44dd9e5ff2554fc6648c/users/4df9d4caa3b341e8853fba400440cd7a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:16.396651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.398124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.398792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.425912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 855/1703] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:16.481424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] MFA Rules not processed for user `4df9d4caa3b341e8853fba400440cd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:16.487883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:16.669094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 849/1704] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:16.670059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.702165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ecd1f-9569-4ddf-b42b-ea6a1a8bf401 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.758371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:16.760706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:16.930765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.932101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:16.932528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:16.934517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:16.935781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:16.940930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fec3a7-ebd6-4d45-86e7-f6c4eaa6d709 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:16.941682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:16.985006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f1e76-31c1-493f-a0ec-459d3f6fe1e1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:16.998696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:16.999385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.001709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.002035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] PATH_INFO: `/v3/users/98a0eafb8b824d2eb3640c1377cbacf8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.004754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a0eafb8b824d2eb3640c1377cbacf8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:17.014590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:17.015195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 856/1705] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:16 2022] POST /identity/v3/projects => generated 365 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:17.016989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da223e-d4fb-4c15-8a52-44fa71cabd90 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.018263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da223e-d4fb-4c15-8a52-44fa71cabd90 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.019197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da223e-d4fb-4c15-8a52-44fa71cabd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.090528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:17.133602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a0eafb8b824d2eb3640c1377cbacf8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.167545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a0eafb8b824d2eb3640c1377cbacf8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.188313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a0eafb8b824d2eb3640c1377cbacf8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.190779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a0eafb8b824d2eb3640c1377cbacf8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.212911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a0eafb8b824d2eb3640c1377cbacf8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.222512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 850/1706] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:16 2022] DELETE /identity/v3/users/98a0eafb8b824d2eb3640c1377cbacf8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:17.224219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:17.228327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.267501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e4da223e-d4fb-4c15-8a52-44fa71cabd90 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:17.268910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e4da223e-d4fb-4c15-8a52-44fa71cabd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.410990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164557f-b300-402c-8b42-d4b648d30a63 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:17.425469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:17.426237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.426552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.426823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.430866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:17.434316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:17.500597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 851/1707] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:17 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:17.500597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:17.505661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.525104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 857/1708] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:17.528432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.530565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.530866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.539109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafc79d-70cb-4f4a-ab20-3845c64e25c9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:17.562103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:17.562788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.563072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.565127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] PATH_INFO: `/v3/projects/5744a6e833cf41cb9c866f2ae12e73af` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.566992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5744a6e833cf41cb9c866f2ae12e73af)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:17.568968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:17.592039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:17.593605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.635026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 858/1709] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:17.640435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:17.668337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6d620-998c-43ba-ae23-f5211f126b2f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:17.696048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5744a6e833cf41cb9c866f2ae12e73af', 'request_id': 'req-7d286d38-1ff2-4283-b5e7-92b3f9844626'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.702524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:17.716927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5744a6e833cf41cb9c866f2ae12e73af', 'request_id': 'req-7d286d38-1ff2-4283-b5e7-92b3f9844626'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.739822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5744a6e833cf41cb9c866f2ae12e73af', 'request_id': 'req-7d286d38-1ff2-4283-b5e7-92b3f9844626'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.757605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] The token cache is being invalidate because project 5744a6e833cf41cb9c866f2ae12e73af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:17.757963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.761498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:17.764399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 852/1710] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:17 2022] DELETE /identity/v3/projects/5744a6e833cf41cb9c866f2ae12e73af => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:17.770592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:17.772741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.933444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:17.934105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.934385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.934661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.935327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:17.936981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:17.944670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286d38-1ff2-4283-b5e7-92b3f9844626 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:17.962765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 859/1711] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:17.963686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:17.964512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:17.965324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:17.965561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:17.965830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] PATH_INFO: `/v3/users/75220c5184bc491d9e9d00272a5d6d90` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:17.969209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:17.969835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75220c5184bc491d9e9d00272a5d6d90)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:17.975945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.124021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75220c5184bc491d9e9d00272a5d6d90'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:18.159344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75220c5184bc491d9e9d00272a5d6d90'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:18.159768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5cdb-aad6-45fc-b036-6fbbb4220db1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.171597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.172480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.172901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.173310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.179064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:18.186104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75220c5184bc491d9e9d00272a5d6d90'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:18.188664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75220c5184bc491d9e9d00272a5d6d90'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:18.214007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75220c5184bc491d9e9d00272a5d6d90'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:18.216248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:18.217871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.226566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 853/1712] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:17 2022] DELETE /identity/v3/users/75220c5184bc491d9e9d00272a5d6d90 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:18.226566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:18.228234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:18.249066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 860/1713] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:18.250187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:18.255349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:18.299573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:18.430646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da214f6-a810-4951-841b-3b8d24564086 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.443415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.445091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.445384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.445662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] PATH_INFO: `/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f/users/ccd49a2d8d45412299746e3a5259fe89/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.453887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:18.484770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb1c9168a8249ffb353e2fefa1b1b0f, user_id=ccd49a2d8d45412299746e3a5259fe89, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:18.491265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.532215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 854/1714] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:18 2022] PUT /identity/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f/users/ccd49a2d8d45412299746e3a5259fe89/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:18.536892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:18.575201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02404a-da49-4769-b35d-71012dc900b3 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.659433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137c28c-4dfe-43b7-80c8-e2b54ae922d8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.676764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.676764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.676764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.676764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.677205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:18.691343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.745378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 855/1715] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:18.747645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:18.762526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd83bc-3c08-42ee-b61e-963f3c500f3c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:18.771527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.772699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.773670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.774496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] PATH_INFO: `/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f/users/ccd49a2d8d45412299746e3a5259fe89/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.777233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb1c9168a8249ffb353e2fefa1b1b0f, user_id=ccd49a2d8d45412299746e3a5259fe89, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:18.780742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05474-a03b-422e-8f7b-628332be184f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:18.794037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 856/1716] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:18 2022] PUT /identity/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f/users/ccd49a2d8d45412299746e3a5259fe89/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:18.805434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ea6f-a41f-4ef3-9c13-4109b94b66dc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.808257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ea6f-a41f-4ef3-9c13-4109b94b66dc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.808870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ea6f-a41f-4ef3-9c13-4109b94b66dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.859898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:18.861084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:18.861648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:18.862257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:18.865836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:18.929982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a5e0ea6f-a41f-4ef3-9c13-4109b94b66dc None None] MFA Rules not processed for user `ccd49a2d8d45412299746e3a5259fe89`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:18.942349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a5e0ea6f-a41f-4ef3-9c13-4109b94b66dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:19.042007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:19.043815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:19.070319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 861/1717] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:43:19.154009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 857/1718] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:19.166376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:19.177541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:19.362680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:19.438881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e1862-0c6b-4461-b707-6c4cf1266f5a service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:19.678928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:19.679924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:19.680361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:19.680951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:19.745464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:19.749228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:19.788738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:19.789255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:19.789255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:19.831398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 862/1719] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:19.847719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:19.849035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:20.078424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:20.115991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 858/1720] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 24 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:20.220063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:20.223275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:20.297376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8a80b-caf0-442e-858a-035ef7fce599 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:20.338712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:20.339372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:20.339656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:20.344426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:20.393862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:20.395385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:20.452101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 863/1721] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:21.072074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.077084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.324637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.424568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355c69-4421-4d75-a0f7-68d73643e0cc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.442880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.445956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.447413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.448618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] PATH_INFO: `/v3/projects/5aa4a0bec4584dcc9b7c2ba2b698902d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.451987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa4a0bec4584dcc9b7c2ba2b698902d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.456106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.574346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa4a0bec4584dcc9b7c2ba2b698902d', 'request_id': 'req-38817d37-8d56-49dc-baa3-b65229a3b77a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.574762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cf37-badb-4836-8dfd-caeb9b02896e service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.589568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa4a0bec4584dcc9b7c2ba2b698902d', 'request_id': 'req-38817d37-8d56-49dc-baa3-b65229a3b77a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.615167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa4a0bec4584dcc9b7c2ba2b698902d', 'request_id': 'req-38817d37-8d56-49dc-baa3-b65229a3b77a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.638586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] The token cache is being invalidate because project 5aa4a0bec4584dcc9b7c2ba2b698902d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:21.640676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.642986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.651217 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 859/1722] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:21 2022] DELETE /identity/v3/projects/5aa4a0bec4584dcc9b7c2ba2b698902d => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:21.653358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:21.657432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:21.766567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.767230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.772599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.773094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] PATH_INFO: `/v3/users/4df9d4caa3b341e8853fba400440cd7a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.779390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df9d4caa3b341e8853fba400440cd7a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.782341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.877253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817d37-8d56-49dc-baa3-b65229a3b77a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:21.897797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:21.898218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:21.901878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:21.902288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] PATH_INFO: `/v3/users/45de5f5f90ab42c2a69567d9fc4e125f` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:21.905000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45de5f5f90ab42c2a69567d9fc4e125f)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:21.914737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:21.933641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:21.967613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df9d4caa3b341e8853fba400440cd7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:21.996385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df9d4caa3b341e8853fba400440cd7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.054913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:22.070893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df9d4caa3b341e8853fba400440cd7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.072621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df9d4caa3b341e8853fba400440cd7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.098538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5222cff1-24ae-4f8f-95ba-de257a7e3734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df9d4caa3b341e8853fba400440cd7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.119930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 864/1723] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:21 2022] DELETE /identity/v3/users/4df9d4caa3b341e8853fba400440cd7a => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:22.121435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.121728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.122006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.132090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45de5f5f90ab42c2a69567d9fc4e125f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.194892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:22.202439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:22.202803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45de5f5f90ab42c2a69567d9fc4e125f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.245661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45de5f5f90ab42c2a69567d9fc4e125f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.246756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45de5f5f90ab42c2a69567d9fc4e125f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.278802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45de5f5f90ab42c2a69567d9fc4e125f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.304905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 860/1724] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:21 2022] DELETE /identity/v3/users/45de5f5f90ab42c2a69567d9fc4e125f => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:22.399073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 865/1725] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:22.514624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:22.521061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:22.626489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:22.629893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:22.660392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd661c-b5f8-4287-b6b2-56ce49a942cf None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:22.736874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d03eb3-833f-48a1-b759-25e42ce27c74 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:22.750585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:22.751233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.751512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.751779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.843294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:22.844051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:22.844531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:22.845071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] PATH_INFO: `/v3/projects/6e8de12b35964aa0a3c7ee3850a441eb` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:22.847007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8de12b35964aa0a3c7ee3850a441eb)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:22.849683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:22.937379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8de12b35964aa0a3c7ee3850a441eb', 'request_id': 'req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.941189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:22.958301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8de12b35964aa0a3c7ee3850a441eb', 'request_id': 'req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.975692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8de12b35964aa0a3c7ee3850a441eb', 'request_id': 'req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:22.996520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:22.999708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] The token cache is being invalidate because project 6e8de12b35964aa0a3c7ee3850a441eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:23.000556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.000899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.002340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-c9f46b5a-58c2-4865-a0d2-ba8eeae4d667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.010411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 866/1726] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:22 2022] DELETE /identity/v3/projects/6e8de12b35964aa0a3c7ee3850a441eb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:23.020820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a106-8924-447e-8ea9-62f21b0050e2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.021171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a106-8924-447e-8ea9-62f21b0050e2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.021455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764a106-8924-447e-8ea9-62f21b0050e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.048097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 861/1727] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:23.057283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.061867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.098084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8764a106-8924-447e-8ea9-62f21b0050e2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.099219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8764a106-8924-447e-8ea9-62f21b0050e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.116709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621acf-5573-47ea-a25e-70193caec18d service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.263646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 867/1728] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:23.275240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.275532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.275797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.319130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.321004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.321004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.321004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] PATH_INFO: `/v3/projects/de8bfb58f8f844debab57c7c6113bf6c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.322198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8bfb58f8f844debab57c7c6113bf6c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.324362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.326280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:23.349500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.356376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.380999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 868/1729] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:23.386196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.414286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb8189-9464-4f82-8a3a-dcdec236f155 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.431089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.432604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.434930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.435434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.436362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:23.439086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.444258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.479860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8bfb58f8f844debab57c7c6113bf6c', 'request_id': 'req-cb0aedf1-3071-42da-b54b-d68d909d3e48'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.481160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 869/1730] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:43:23.484731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.499977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8bfb58f8f844debab57c7c6113bf6c', 'request_id': 'req-cb0aedf1-3071-42da-b54b-d68d909d3e48'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.512025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2af56-5b33-4792-807c-b84400c3ce4c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.530878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8bfb58f8f844debab57c7c6113bf6c', 'request_id': 'req-cb0aedf1-3071-42da-b54b-d68d909d3e48'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.553973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] The token cache is being invalidate because project de8bfb58f8f844debab57c7c6113bf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:23.558609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.562779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-cb0aedf1-3071-42da-b54b-d68d909d3e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:23.565801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 862/1731] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:23 2022] DELETE /identity/v3/projects/de8bfb58f8f844debab57c7c6113bf6c => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:23.570372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82022fa-6a9f-44db-9f83-1b34b51f6656 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.570906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82022fa-6a9f-44db-9f83-1b34b51f6656 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.571999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82022fa-6a9f-44db-9f83-1b34b51f6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.619791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.620691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.621271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.621711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.631756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b82022fa-6a9f-44db-9f83-1b34b51f6656 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.637405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.637738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b82022fa-6a9f-44db-9f83-1b34b51f6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.651903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.663774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 863/1732] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:23.679498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.679795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.680066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.728377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:23.729626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.761215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 864/1733] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:23.763035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.765010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 870/1734] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:23.768298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:23.773973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:23.790237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10e3a-db41-429c-89eb-a03a832cfbec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:23.955102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:23.956692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:23.957415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:23.958531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:23.959562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:23.960066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:23.961996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:23.992296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:24.014243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 865/1735] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:24.024985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.072613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88d83-aa8d-4853-b423-a21cc44f4d99 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.078859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.079786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.080106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.080472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.081125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.085620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.100031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12705aa-f556-410d-bc2f-109c8a09a42f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.124556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.125276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.125563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.125841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.126565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.134719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.156297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 866/1736] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:24 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:24.159273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.202496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 871/1737] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:23 2022] POST /identity/v3/users => generated 289 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:24.209839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.228799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bd905-3911-4629-862b-aae3614311fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.325934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.327438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.327741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.328025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.328703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.331276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.349253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 872/1738] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:24.350178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:24.351381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.365105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5620c-083f-41c9-b81a-5865106caaa9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.370527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.371429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.371869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.372289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.373097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.375307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.391702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 873/1739] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:24.392838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.395429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b7107-b3f5-492d-b690-f12d2ddd41db admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.405778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aea467-c592-44b7-b4dd-a0403cb2d4f8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.410824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.411358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.412197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.412313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.412734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.413177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] PATH_INFO: `/v3/projects/f768f3c9282f48189f21f2b92de23c30/users/58897c52ebb4454cadaf70bf2fedaa4a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.413404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.413700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.414389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.423268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.435952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f768f3c9282f48189f21f2b92de23c30, user_id=58897c52ebb4454cadaf70bf2fedaa4a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.440263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af95464-fb40-40ef-9eda-f7664d57d532 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.469354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 874/1740] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:24 2022] PUT /identity/v3/projects/f768f3c9282f48189f21f2b92de23c30/users/58897c52ebb4454cadaf70bf2fedaa4a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:24.488723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cda28-488d-466d-8b91-898004ca755f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.489234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cda28-488d-466d-8b91-898004ca755f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.489668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cda28-488d-466d-8b91-898004ca755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.492827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 867/1741] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:24 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:24.511424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.552817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e455514-b956-40db-9306-d6531a48249c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.563014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b07cda28-488d-466d-8b91-898004ca755f None None] MFA Rules not processed for user `58897c52ebb4454cadaf70bf2fedaa4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:24.567407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b07cda28-488d-466d-8b91-898004ca755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:24.746501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.747487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.747899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.748365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.749307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.752043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.779205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 868/1742] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:24.781001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.786865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 875/1743] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:24.788146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cda28-488d-466d-8b91-898004ca755f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.803843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac647515-9885-4b5b-809b-1f24e00d7c1e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.811924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.813200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.813655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.814321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.815200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.817147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cda28-488d-466d-8b91-898004ca755f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.817803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.842411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.847745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 869/1744] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:24.850781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.852333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.853137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.853649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.858546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.861091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.868857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c648f5-15b0-4084-b1a8-b8081e4ab6d7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:24.878652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:24.879725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:24.880237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:24.880740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] PATH_INFO: `/v3/projects/a5235d60b08c4d1ba0ba22d2f6190561/users/e8510df8785549bc8a6ec0b4218397c3/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:24.911934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5235d60b08c4d1ba0ba22d2f6190561, user_id=e8510df8785549bc8a6ec0b4218397c3, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:24.922333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 876/1745] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:24 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:24.923625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:24.936755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22bca9-a5e1-479d-9694-cbad6f2cc1cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:24.938998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:24.993826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 870/1746] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:24 2022] PUT /identity/v3/projects/a5235d60b08c4d1ba0ba22d2f6190561/users/e8510df8785549bc8a6ec0b4218397c3/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:25.005677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.005807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.006044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.098676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] MFA Rules not processed for user `e8510df8785549bc8a6ec0b4218397c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:25.100366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.132885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68575a3a-01d1-4ef0-bf68-ce2841fbdb04 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.264428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 871/1747] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:25.266757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.357965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.359245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.359546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.359816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.361808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.377893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.443275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:25.466395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 877/1748] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:24 2022] POST /identity/v3/users => generated 290 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:25.469332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.509580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae5ff9-e91d-4af0-a1ac-e51a38b43e9d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.535317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.541464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.543862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.543862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.543862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.545508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.563822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef0de9-09b6-4ad5-af03-db6d3418431f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.584222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.586933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.587269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.587499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.588194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.590153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 878/1749] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:25.591341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.592496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.624833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff087aa-5e45-4fc6-898b-9f633f2bc2bd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.659156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.664117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.664749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.665460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.668200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.678629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.678835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 872/1750] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/projects => generated 369 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:25.680580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.688847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 879/1751] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:25.702742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:25.714503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:25.772345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7037c-4ae3-4a7f-8516-ed2c2129e0b1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.927652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ffb94-6479-44c3-801b-bb7c10673e57 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:25.953465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.954439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.955266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.955696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] PATH_INFO: `/v3/projects/aa494837caec44dd9e5ff2554fc6648c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.957134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:25.957765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:25.958047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:25.958356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:25.959003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.959249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa494837caec44dd9e5ff2554fc6648c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:25.960994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:25.963484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:26.019203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 873/1752] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:25 2022] POST /identity/v3/users => generated 291 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:26.020363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.054653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb400c7-fa1f-4931-870b-422ca15a6ac3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:26.060190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:26.062178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:26.062332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:26.062608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] PATH_INFO: `/v3/projects/dbe974491ea04fcdab5285fe42f81e83/users/47288e54d6704c34b924082da4e174fc/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:26.104651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe974491ea04fcdab5285fe42f81e83, user_id=47288e54d6704c34b924082da4e174fc, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:26.110426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:26.127468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:26.153786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 874/1753] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:26 2022] PUT /identity/v3/projects/dbe974491ea04fcdab5285fe42f81e83/users/47288e54d6704c34b924082da4e174fc/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:26.153786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.239133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa494837caec44dd9e5ff2554fc6648c', 'request_id': 'req-9ff9920a-a557-4570-9ef9-24519849a2cc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.267266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa494837caec44dd9e5ff2554fc6648c', 'request_id': 'req-9ff9920a-a557-4570-9ef9-24519849a2cc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.297800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa494837caec44dd9e5ff2554fc6648c', 'request_id': 'req-9ff9920a-a557-4570-9ef9-24519849a2cc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.314002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588e249-dbbd-4fbf-a4cc-3256a1346a73 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:26.341941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] The token cache is being invalidate because project aa494837caec44dd9e5ff2554fc6648c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:26.345843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.348594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ff9920a-a557-4570-9ef9-24519849a2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.351158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 880/1754] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:25 2022] DELETE /identity/v3/projects/aa494837caec44dd9e5ff2554fc6648c => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:26.353494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:26.358797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:26.359330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:26.382811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:26.435054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] MFA Rules not processed for user `47288e54d6704c34b924082da4e174fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:26.436576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:26.466691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:26.467350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:26.467629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:26.468136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:26.475185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:26.481363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:26.513579 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 875/1755] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:26.514900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.530208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:26.552738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddb544-1f0c-4d35-88bd-a7ea000dd97a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:26.559588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:26.560287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:26.560572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:26.560937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] PATH_INFO: `/v3/users/ccd49a2d8d45412299746e3a5259fe89` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:26.562112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd49a2d8d45412299746e3a5259fe89)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:26.564145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:26.624677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 881/1756] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:26.626454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.628339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:26.669877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba685a-4710-447c-951c-9d76ead83834 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:26.679832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd49a2d8d45412299746e3a5259fe89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.688033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:26.688952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:26.689207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:26.689494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] PATH_INFO: `/v3/projects/3011778f19154622a893508a5363eab9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:26.694734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3011778f19154622a893508a5363eab9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:26.702417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd49a2d8d45412299746e3a5259fe89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.703107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:26.721399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd49a2d8d45412299746e3a5259fe89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.722243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd49a2d8d45412299746e3a5259fe89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.735787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd49a2d8d45412299746e3a5259fe89'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.744939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 876/1757] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:26 2022] DELETE /identity/v3/users/ccd49a2d8d45412299746e3a5259fe89 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:26.749386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.754804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:26.831690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3011778f19154622a893508a5363eab9', 'request_id': 'req-2631a232-a9c6-4381-a7c7-275cc1206675'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.854454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3011778f19154622a893508a5363eab9', 'request_id': 'req-2631a232-a9c6-4381-a7c7-275cc1206675'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.869909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3011778f19154622a893508a5363eab9', 'request_id': 'req-2631a232-a9c6-4381-a7c7-275cc1206675'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.895795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] The token cache is being invalidate because project 3011778f19154622a893508a5363eab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:26.896042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.898380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:26.904603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 882/1758] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:26 2022] DELETE /identity/v3/projects/3011778f19154622a893508a5363eab9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:26.904603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:26.907474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:26.911678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a64006-0e8e-41ec-be16-ffb0524992a9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:26.975937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:27.019725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:27.071676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.079776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.080398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.080882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] PATH_INFO: `/v3/projects/e933b799c83440b6bacb3aa096cf5c6a/users/f6731a9e74264357b4fad4ce7e8cbbb5/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.094217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631a232-a9c6-4381-a7c7-275cc1206675 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:27.104451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.105252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.105513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.106089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] PATH_INFO: `/v3/users/fc6b45f7748e4f6f95b6389b77dbddf5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.107394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6b45f7748e4f6f95b6389b77dbddf5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.109652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:27.118835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e933b799c83440b6bacb3aa096cf5c6a, user_id=f6731a9e74264357b4fad4ce7e8cbbb5, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.124161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:27.157858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 877/1759] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:26 2022] PUT /identity/v3/projects/e933b799c83440b6bacb3aa096cf5c6a/users/f6731a9e74264357b4fad4ce7e8cbbb5/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:27.160044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:27.164537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.207268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6b45f7748e4f6f95b6389b77dbddf5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:27.216823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6b45f7748e4f6f95b6389b77dbddf5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:27.247093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6b45f7748e4f6f95b6389b77dbddf5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:27.247972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6b45f7748e4f6f95b6389b77dbddf5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:27.269894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-93b3b9bc-676e-4820-9428-40f59a4bd32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6b45f7748e4f6f95b6389b77dbddf5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:27.277937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 883/1760] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:26 2022] DELETE /identity/v3/users/fc6b45f7748e4f6f95b6389b77dbddf5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:27.279429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.279894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.280275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.321792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:27.327651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.355191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333762-e93a-47f3-bc56-1002e92dc51a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:27.467836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 884/1761] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:27.467836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:27.467836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.487428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.488059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.488342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.488614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.489261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.496025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed763ab-cbd9-4933-b575-8af584a9be95 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:27.498870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f91ca0-d5ae-468d-92c1-a4f20b2cff3c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:27.507428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.512004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.512422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.512812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.513599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.515530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1404d8-72e8-4a07-bf56-bb33d34188f4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:27.545777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 885/1762] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:27.545777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.545777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.545777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.568783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 878/1763] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/projects => generated 379 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:27.569641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:27.572109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.577521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13b13-c809-47a6-b7f2-ab3d519d0a92 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.577868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13b13-c809-47a6-b7f2-ab3d519d0a92 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.578255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13b13-c809-47a6-b7f2-ab3d519d0a92 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.582483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 879/1764] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:43:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:27.586187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf488989-93c3-417c-ac37-2353ef0b0fc5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.586479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf488989-93c3-417c-ac37-2353ef0b0fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.591198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf488989-93c3-417c-ac37-2353ef0b0fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.613073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:27.624541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bf488989-93c3-417c-ac37-2353ef0b0fc5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:27.627113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bf488989-93c3-417c-ac37-2353ef0b0fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.722852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 886/1765] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:27.726542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:27.741424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0be7-f014-4040-ac1e-5625880748d9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:27.761301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.763935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.764354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.764871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] PATH_INFO: `/v3/projects/e933b799c83440b6bacb3aa096cf5c6a/users/f6731a9e74264357b4fad4ce7e8cbbb5/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.767182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e933b799c83440b6bacb3aa096cf5c6a, user_id=f6731a9e74264357b4fad4ce7e8cbbb5, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.770975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:27.788930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 887/1766] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:27 2022] PUT /identity/v3/projects/e933b799c83440b6bacb3aa096cf5c6a/users/f6731a9e74264357b4fad4ce7e8cbbb5/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:27.790788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:27.793106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.802451 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:27.849119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 880/1767] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:27.857052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.859231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.859509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.941295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c952-588c-496b-af91-6203c25ce8b3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:27.943691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:27.949820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:27.958894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:27.959963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:27.960424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:27.961306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:27.962232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:27.964531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a97075-84e6-4b2b-a27a-596634889673 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.038937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 888/1768] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:28.045011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.045176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.045528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.156371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] MFA Rules not processed for user `f6731a9e74264357b4fad4ce7e8cbbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:28.157735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:28.212183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 881/1769] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:28.213734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.216848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:28.313943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 889/1770] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:28.314951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.331457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cf86c-d2e0-47bc-a195-86b003fcf524 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.342292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.343095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.343577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.343985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.344766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:28.345426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.347550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.353219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce737f7-25d9-45f0-9ac8-0ad33afa3929 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.359361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.360314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.360733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.361158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.369626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 890/1771] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:28.382248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.388310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.393814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c47a69-9492-4c77-b2cf-a5af30b7c882 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.400623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d40883-f879-4859-a7e1-33ac40d644c0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.405943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.407397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.407950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.419316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.420530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.422525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.435723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 882/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:28.439467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.439751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.441643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.445264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 883/1773] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:43:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:28.448251 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.454429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 891/1774] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:28.455717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.456206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:28.458431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:28.478911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:28.501265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc01f23-e7ff-400e-a089-6c80f1cf5167 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.514003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.515367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.515596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.515871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.540272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.542154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.578411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633e806-7e49-4bb4-b96a-c8a99ae8cd2c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.578988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 884/1775] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:28.582463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.595690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.596445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.596922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.597389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.612848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d85fa8-e3ec-4741-b10f-7cf3329a5223 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.617582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.624244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.627873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.628839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.630131 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.630549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.635855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.638102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addb5e9-7dc1-4e7c-8ed4-44f81b4d18bb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.650841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 892/1776] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:28.652094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.681464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfa374-1131-4f67-ac48-55603a671166 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.706334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.708258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.711212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.712290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] PATH_INFO: `/v3/projects/e4846039e3c94542a63e6fd49fa760e0/users/58e20cf1b6e44bb3b1b7b427805d57ba/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.716156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 885/1777] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:28 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:28.721672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.722201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.726266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.773241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4846039e3c94542a63e6fd49fa760e0, user_id=58e20cf1b6e44bb3b1b7b427805d57ba, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.776599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:28.807706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 893/1778] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:28 2022] PUT /identity/v3/projects/e4846039e3c94542a63e6fd49fa760e0/users/58e20cf1b6e44bb3b1b7b427805d57ba/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:28.812745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:28.889809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:28.898957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:28.949218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a03265-a29e-449d-b937-044913497b29 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:28.958253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:28.959571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:28.960793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:28.961977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:28.963162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:28.965503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.002818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 894/1779] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:28 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:29.002818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.027194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79463638-e38d-4a8e-acd5-91979d5d32cd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:29.041659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:29.042375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.042664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.042938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.043598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:29.049976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.084490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 895/1780] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:29.087968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.105331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:29.122542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39fa78-52e5-46ec-8b6f-0666879dae72 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:29.148256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:29.149151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.149582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.150207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.152873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:29.156842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 886/1781] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:29.157796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.174770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.185670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374db3fe-2a3e-4817-867a-2e25ff4d35ae None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:29.198679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:29.200049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.200331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.201818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] PATH_INFO: `/v3/projects/e4846039e3c94542a63e6fd49fa760e0/users/58e20cf1b6e44bb3b1b7b427805d57ba/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.207689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4846039e3c94542a63e6fd49fa760e0, user_id=58e20cf1b6e44bb3b1b7b427805d57ba, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:29.217111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6db70-947a-4eaf-9377-879150c34add admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.242922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 896/1782] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:29.246872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.255664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 887/1783] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:29 2022] PUT /identity/v3/projects/e4846039e3c94542a63e6fd49fa760e0/users/58e20cf1b6e44bb3b1b7b427805d57ba/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:29.267171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.267617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.267972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.275882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2353c-8e8d-4e51-92a4-92a295c487c9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:29.387143 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] MFA Rules not processed for user `58e20cf1b6e44bb3b1b7b427805d57ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:29.392677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:29.436713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:29.457617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:29.458061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.458382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.458654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.459308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:29.465437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.495980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 897/1784] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:29.503674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.546792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5411bf-b85c-41bf-b493-a5e722b7731c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:29.569795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:29.570564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.573019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.574053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] PATH_INFO: `/v3/projects/c5cbe1843b5a41a4ad17ab79c51e2a45/users/a1c9a5c015c5426b9c9c5c1bc60224ba/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.622632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cbe1843b5a41a4ad17ab79c51e2a45, user_id=a1c9a5c015c5426b9c9c5c1bc60224ba, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:29.629950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b57895-4d88-4c66-b52c-38e43fc1105d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:29.666363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 898/1785] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:29 2022] PUT /identity/v3/projects/c5cbe1843b5a41a4ad17ab79c51e2a45/users/a1c9a5c015c5426b9c9c5c1bc60224ba/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:29.680846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:29.681167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:29.681530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:29.690628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 888/1786] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:29.699884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:29.772875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] MFA Rules not processed for user `a1c9a5c015c5426b9c9c5c1bc60224ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:29.774208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:29.902908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371609e1-d764-4cff-91c0-20f46af84071 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:30.047460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 899/1787] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:30.054194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:30.058463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:30.077631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:30.078468 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:30.078913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:30.079393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:30.195125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:30.292318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:30.298529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:30.353980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703e1e-9a2d-4de5-9c0b-7da438f2058f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:30.368948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 889/1788] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:30.372887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:30.379655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:30.406132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:30.414608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:30.418042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:30.419669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:30.454028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:30.455973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:30.479922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 900/1789] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:30.481299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:30.579803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ef47-b4f5-4992-b013-092f5fb9eaa3 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:30.598012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:30.600439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:30.601325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:30.604784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:30.605132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] PATH_INFO: `/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:30.608189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb1c9168a8249ffb353e2fefa1b1b0f)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:30.612314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:30.676756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802d06e-72ff-4563-b1fb-ae8733cd959d service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:30.690854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:30.691547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:30.692167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:30.692461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:30.693166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:30.698280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764606e-aad7-4dad-9508-453b18d80ed9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:30.745519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb1c9168a8249ffb353e2fefa1b1b0f', 'request_id': 'req-1e0fb5d7-6b4f-41ec-b476-062a113998ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:30.760041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 901/1790] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:30 2022] POST /identity/v3/projects => generated 383 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:30.760740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb1c9168a8249ffb353e2fefa1b1b0f', 'request_id': 'req-1e0fb5d7-6b4f-41ec-b476-062a113998ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:30.763880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:30.764633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:30.765923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:30.790464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb1c9168a8249ffb353e2fefa1b1b0f', 'request_id': 'req-1e0fb5d7-6b4f-41ec-b476-062a113998ab'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:30.800165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] The token cache is being invalidate because project dcb1c9168a8249ffb353e2fefa1b1b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:30.800743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:30.802119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:30.804528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 890/1791] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:30 2022] DELETE /identity/v3/projects/dcb1c9168a8249ffb353e2fefa1b1b0f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:30.805688 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:30.809631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:30.823024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] MFA Rules not processed for user `ba9ad96c6092431abc7b474ac7a26cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:30.830314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:30.979259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 902/1792] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:30.979259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:30.986384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:31.071446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fb5d7-6b4f-41ec-b476-062a113998ab admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.109344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:31.191634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca030429-f640-4888-a6d9-f7479342d0fd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.207854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.208945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.209487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.210930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.212776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.223169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd31ca-af63-4cd2-818b-5fbfaf301008 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.226450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.227061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.227390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.227672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.230289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:31.276947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 903/1793] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:30 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:31.278882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323eb9-4ab1-4d98-acc4-9a7df9e77459 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.282028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323eb9-4ab1-4d98-acc4-9a7df9e77459 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.283366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323eb9-4ab1-4d98-acc4-9a7df9e77459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.344638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.346492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.360969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-70323eb9-4ab1-4d98-acc4-9a7df9e77459 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:31.364849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-70323eb9-4ab1-4d98-acc4-9a7df9e77459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:31.375499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 891/1794] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:31.382927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.395855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 904/1795] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:31.403927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.404437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.404899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.449236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3935b7-896f-4a39-9334-a2bffd5b8b5a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.461175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.464537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.464692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:31.465896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:31.468382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.469577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.474632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.481720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 905/1796] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:31.482945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.485825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:31.504544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.517182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4d1c9-84a1-4cb0-95ef-d920b3d6a6ff None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.549172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.549880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.554137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.554137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] PATH_INFO: `/v3/projects/163b984262a8462eb480f641eb5a8ea6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.554137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163b984262a8462eb480f641eb5a8ea6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.554137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.573846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 892/1797] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:31.576558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.604912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c6b3-b812-42d9-8a94-e24980271141 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.613477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.614258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.614637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.615123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.615908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:31.617525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.620248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.644393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 893/1798] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:31.644393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.661822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1a59f-fcc3-4fb7-b021-805c58014dd9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:31.671223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:31.672452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:31.672863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:31.673205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] PATH_INFO: `/v3/projects/930ee995663b4b5a84f1ce236a850d52/users/dd464c1362aa4939ad97a73ecef75a80/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:31.719494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930ee995663b4b5a84f1ce236a850d52, user_id=dd464c1362aa4939ad97a73ecef75a80, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:31.724898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:31.737862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163b984262a8462eb480f641eb5a8ea6', 'request_id': 'req-d51994bc-7593-487a-a103-61609745bc21'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:31.746662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:31.753307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163b984262a8462eb480f641eb5a8ea6', 'request_id': 'req-d51994bc-7593-487a-a103-61609745bc21'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:31.786175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163b984262a8462eb480f641eb5a8ea6', 'request_id': 'req-d51994bc-7593-487a-a103-61609745bc21'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:31.793105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 894/1799] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:31 2022] PUT /identity/v3/projects/930ee995663b4b5a84f1ce236a850d52/users/dd464c1362aa4939ad97a73ecef75a80/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:31.794099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.820490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] The token cache is being invalidate because project 163b984262a8462eb480f641eb5a8ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:31.828210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:31.829476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:31.837918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 906/1800] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:31 2022] DELETE /identity/v3/projects/163b984262a8462eb480f641eb5a8ea6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:31.841608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:31.854281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:32.119526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917e076-4557-4d46-acee-7f7bc35a3466 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.151987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.153702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.154348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.155386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.157062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.159910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.168077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51994bc-7593-487a-a103-61609745bc21 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.182710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.183996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.185567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.186103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.188484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.192372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.220333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 907/1801] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:32.221382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:32.231003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:32.239427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 895/1802] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:31 2022] POST /identity/v3/projects => generated 377 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:32.242569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:32.261560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b5b1-21d7-4873-8707-18c0a6f44e1e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.263786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:32.404545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b7d73-1003-410a-a97e-9765c8b3205e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.412840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.414396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.415482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.415865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] PATH_INFO: `/v3/projects/930ee995663b4b5a84f1ce236a850d52/users/dd464c1362aa4939ad97a73ecef75a80/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.419162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930ee995663b4b5a84f1ce236a850d52, user_id=dd464c1362aa4939ad97a73ecef75a80, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.424393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.430976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.431510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.431926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.432354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] PATH_INFO: `/v3/users/400ce235983a408ebc3928e20aa22984` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.435472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400ce235983a408ebc3928e20aa22984)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.439414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.455908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 896/1803] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:32 2022] PUT /identity/v3/projects/930ee995663b4b5a84f1ce236a850d52/users/dd464c1362aa4939ad97a73ecef75a80/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:32.457156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:32.459409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:32.568606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400ce235983a408ebc3928e20aa22984'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:32.589031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400ce235983a408ebc3928e20aa22984'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:32.611898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:32.623521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400ce235983a408ebc3928e20aa22984'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:32.624858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400ce235983a408ebc3928e20aa22984'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:32.643068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bd296ed-7afb-400b-a83d-9da38a9a7548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400ce235983a408ebc3928e20aa22984'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:32.657855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 908/1804] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:32 2022] DELETE /identity/v3/users/400ce235983a408ebc3928e20aa22984 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:32.661958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.662515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.662893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.721321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a687-0848-4c7a-ae02-e1dee3e9f151 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.757791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] MFA Rules not processed for user `dd464c1362aa4939ad97a73ecef75a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:32.759620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:32.844124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.844853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.845232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.845595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.846604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.849002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.878838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 897/1805] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:32 2022] POST /identity/v3/users => generated 289 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:32.879974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:32.882414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:32.903010 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43e48-d9b6-47c5-8f18-3086a270d47f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:32.925484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:32.926226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:32.926512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:32.926818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] PATH_INFO: `/v3/users/e8510df8785549bc8a6ec0b4218397c3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:32.945132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8510df8785549bc8a6ec0b4218397c3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:32.957287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 909/1806] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:32.973112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:32.973932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:32.976225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.012686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97f9a3-d879-4972-af2b-8be076aee43d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:33.032962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:33.034503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.034972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.035488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.037779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:33.041085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:33.061350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:33.082991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 910/1807] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:33.084185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:33.090582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.101932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8510df8785549bc8a6ec0b4218397c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:33.129647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8510df8785549bc8a6ec0b4218397c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:33.163471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8510df8785549bc8a6ec0b4218397c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:33.167092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8510df8785549bc8a6ec0b4218397c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:33.190882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8510df8785549bc8a6ec0b4218397c3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:33.215641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 898/1808] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:32 2022] DELETE /identity/v3/users/e8510df8785549bc8a6ec0b4218397c3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:33.216851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:33.224832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.228066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e37674-d91e-49a4-bab7-8b665186a90d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:33.408649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87396ef-9bed-4c0e-aa0b-6d21421441a9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:33.416335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:33.416820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:33.421382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.421830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.422255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.428926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.447361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.447960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.448414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.449325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:33.452700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7d779-82e9-447c-bdb0-941e4d8890a1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:33.485432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 899/1809] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:33.491767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.492153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.492311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.526408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:33.546425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:33.550463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.572304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 900/1810] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:33.573398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:33.601702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877233d9-94ef-44b5-81e9-ed337bf32565 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:33.607771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:33.608619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.609012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.609368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] PATH_INFO: `/v3/projects/a9f34fff9d994df6ac3dc8d285f8159b/users/3d132888f62e4a11a9e3a7c34c0b1c13/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.636053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:33.642199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:33.655877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f34fff9d994df6ac3dc8d285f8159b, user_id=3d132888f62e4a11a9e3a7c34c0b1c13, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:33.659138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5902d1d-f54a-4901-8792-22ef08d2a3ac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:33.677776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 911/1811] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:33.679579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:33.701726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.723265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 901/1812] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:33 2022] PUT /identity/v3/projects/a9f34fff9d994df6ac3dc8d285f8159b/users/3d132888f62e4a11a9e3a7c34c0b1c13/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:33.736903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:33.737324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:33.737689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:33.796173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] MFA Rules not processed for user `3d132888f62e4a11a9e3a7c34c0b1c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:33.796173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:33.991532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 902/1813] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:33.995653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.004947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:34.041206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431e70-bee6-4f0c-8d35-8a8af8acd63b service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.215538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517bae2-1faf-4111-892d-b8eb2367d762 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.223733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.224658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.225355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.225714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.226847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.229751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.268727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.270543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.271079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.272597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.289444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.291800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.311956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 912/1814] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:34.313137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.316014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:34.321912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 903/1815] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:33 2022] POST /identity/v3/projects => generated 377 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:34.327644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.386226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d6787-e31a-4dde-8489-f98d8feff931 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.439654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:34.450891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.451711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.452089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.452617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.458907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:34.534941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.536931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.553471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 913/1816] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:34.614503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03e49-4ed6-4f2e-9792-9f4e7dd4fba8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.637893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.639690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:34.650645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.651293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.651570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.651839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.652504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.655803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.673665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32790095-1d3c-473b-8fd1-7e2e60220d84 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.703801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.704802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.705295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.705663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] PATH_INFO: `/v3/projects/990f2888565b4afc946ec465688f31d0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.708022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990f2888565b4afc946ec465688f31d0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.710451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.736417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 904/1817] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:34 2022] POST /identity/v3/users => generated 295 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:34.737791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.786564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810657-d4f4-4727-8d54-284ebec4f68a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.794909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.796636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.797124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.797734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.799529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:34.802506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:34.820523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 905/1818] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:34.822803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990f2888565b4afc946ec465688f31d0', 'request_id': 'req-01b0ae17-34e4-4f69-b45c-243926381f40'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:34.825443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:34.835714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990f2888565b4afc946ec465688f31d0', 'request_id': 'req-01b0ae17-34e4-4f69-b45c-243926381f40'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:34.840447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408911a3-5a95-4f8b-ab7c-7c5e69e2e391 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:34.857542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990f2888565b4afc946ec465688f31d0', 'request_id': 'req-01b0ae17-34e4-4f69-b45c-243926381f40'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:34.877354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] The token cache is being invalidate because project 990f2888565b4afc946ec465688f31d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:34.877558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:34.878727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-01b0ae17-34e4-4f69-b45c-243926381f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:34.886671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 914/1819] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:34 2022] DELETE /identity/v3/projects/990f2888565b4afc946ec465688f31d0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:34.888953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b00c-4c9e-4936-abf6-04045c51a018 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.889516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b00c-4c9e-4936-abf6-04045c51a018 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.889876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b00c-4c9e-4936-abf6-04045c51a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:34.942097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-09b9b00c-4c9e-4936-abf6-04045c51a018 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:34.944334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-09b9b00c-4c9e-4936-abf6-04045c51a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:34.974967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:34.975765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:34.977049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:34.977330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] PATH_INFO: `/v3/projects/2af4150c5d9747368bd8aadebf0213cf/users/57009afed6e84243803b4360126c5b49/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.013435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:35.025586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af4150c5d9747368bd8aadebf0213cf, user_id=57009afed6e84243803b4360126c5b49, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.032105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.060931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 906/1820] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:34 2022] PUT /identity/v3/projects/2af4150c5d9747368bd8aadebf0213cf/users/57009afed6e84243803b4360126c5b49/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:35.066049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.070566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.072515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 915/1821] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:35.074111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.074408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.074708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.101010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:35.103935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.119441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:35.190669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a716-a3ad-44b9-ae89-26ff3368b8c8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.205264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.205904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.206323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.206478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.207146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.209141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.222141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 916/1822] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:35.222141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.223213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.242846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6488-9963-4b1f-b5a5-4c07c059dd8d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.246215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 907/1823] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:35.247235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.249948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.250805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.251092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.251373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] PATH_INFO: `/v3/projects/a5235d60b08c4d1ba0ba22d2f6190561` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.252538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5235d60b08c4d1ba0ba22d2f6190561)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.255102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.260948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94b89a-fc89-45a7-8fc1-80ed6e9a78d5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.265692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.266333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.266595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.266857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.267509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:35.267811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.269426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.283416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 908/1824] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:35.284328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.296082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c09b7-3256-4266-ab00-859ceefd66f1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.308992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5235d60b08c4d1ba0ba22d2f6190561', 'request_id': 'req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.316027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5235d60b08c4d1ba0ba22d2f6190561', 'request_id': 'req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.324701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5235d60b08c4d1ba0ba22d2f6190561', 'request_id': 'req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.335887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] The token cache is being invalidate because project a5235d60b08c4d1ba0ba22d2f6190561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:35.336250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.337442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.341981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 917/1825] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:35 2022] DELETE /identity/v3/projects/a5235d60b08c4d1ba0ba22d2f6190561 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:35.341981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.341981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.358020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.358798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.359071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.359344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] PATH_INFO: `/v3/projects/2af4150c5d9747368bd8aadebf0213cf/users/57009afed6e84243803b4360126c5b49/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.361274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af4150c5d9747368bd8aadebf0213cf, user_id=57009afed6e84243803b4360126c5b49, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.364004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.375214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 909/1826] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:35 2022] PUT /identity/v3/projects/2af4150c5d9747368bd8aadebf0213cf/users/57009afed6e84243803b4360126c5b49/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:35.376216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.377871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.418094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee6be-9ce8-438a-ae0e-19b988440d5d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.446098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9099f-7516-4d6d-9d20-ee72011d5a33 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.450906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.451544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.451818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.452092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] PATH_INFO: `/v3/users/f6731a9e74264357b4fad4ce7e8cbbb5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.453273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6731a9e74264357b4fad4ce7e8cbbb5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.455258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.461053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:35.466972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:35.479852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.480513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.480795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.481068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.481698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.483912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd429ca9-6dfb-4bb0-90c2-ebe817143b03 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.508504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6731a9e74264357b4fad4ce7e8cbbb5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.515584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 918/1827] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:35 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:35.516709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.516997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.517273 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.521429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6731a9e74264357b4fad4ce7e8cbbb5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.529282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6731a9e74264357b4fad4ce7e8cbbb5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.530029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6731a9e74264357b4fad4ce7e8cbbb5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.538696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6731a9e74264357b4fad4ce7e8cbbb5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:35.545410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 910/1828] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:35 2022] DELETE /identity/v3/users/f6731a9e74264357b4fad4ce7e8cbbb5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:35.546184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] MFA Rules not processed for user `57009afed6e84243803b4360126c5b49`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:35.546285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.547421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.547527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.646664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ed0b6-e636-4856-9f1b-cf043249f34f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.647721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 919/1829] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:35.650381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.650717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.657090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.658228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.658741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.659976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.661538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.666704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.705966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 911/1830] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:35 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:35.707039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.723191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e41d-6c97-4299-abe1-4b3c6a27404b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.730503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.731123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.731402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.731671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.732320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.734337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.749206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 912/1831] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:35.753589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.770924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821a23-cb8e-4f1b-bbf7-8866080b7133 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.784076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.784704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.785206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.785573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.786212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.790851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.799146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bf6b9-d8f2-4a6f-b7fb-3b13009b8d47 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.808122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.810282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.810282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.810819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.816997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.819339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 913/1832] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:35.836069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.848055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29f350-0d33-459b-8301-a05a7a9dd84b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:35.855119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:35.855838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.856169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.856618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] PATH_INFO: `/v3/projects/22ac81d9f88d4390a56de05805ac329b/users/bb3aa6f2baf846338217e02a960ae116/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.873434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ac81d9f88d4390a56de05805ac329b, user_id=bb3aa6f2baf846338217e02a960ae116, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.876161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538870a5-c571-4be7-aa06-ead681d1c7aa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.903957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 914/1833] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:35 2022] PUT /identity/v3/projects/22ac81d9f88d4390a56de05805ac329b/users/bb3aa6f2baf846338217e02a960ae116/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:35.921008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:35.921008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:35.921491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:35.959723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:35.959923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] MFA Rules not processed for user `bb3aa6f2baf846338217e02a960ae116`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:35.960866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.961269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:35.986195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 920/1834] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:35.990791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:35.995992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:35.997673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.040696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e632-cd85-411d-99e8-470870968a93 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.067748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.138546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 915/1835] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:36.139696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.174211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.174809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.175101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.175381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] PATH_INFO: `/v3/users/58897c52ebb4454cadaf70bf2fedaa4a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.179387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58897c52ebb4454cadaf70bf2fedaa4a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.181708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.257129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3971ba-89bf-4a11-9d22-1dff8be29182 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.270385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.271301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.271771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.272139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.273285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.276330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.319192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58897c52ebb4454cadaf70bf2fedaa4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.356678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58897c52ebb4454cadaf70bf2fedaa4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.375465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58897c52ebb4454cadaf70bf2fedaa4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.390284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 916/1836] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:36.390284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.390284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.396673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58897c52ebb4454cadaf70bf2fedaa4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.424567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58897c52ebb4454cadaf70bf2fedaa4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.439681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 921/1837] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:35 2022] DELETE /identity/v3/users/58897c52ebb4454cadaf70bf2fedaa4a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:36.439681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.444377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.485268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52b30-5bd3-43fe-b76e-a36a5696e48b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.569790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.586270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.587852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.588189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.588470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] PATH_INFO: `/v3/projects/e933b799c83440b6bacb3aa096cf5c6a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.590100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e933b799c83440b6bacb3aa096cf5c6a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.592409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.596257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d0ea-71cd-4fd1-ab4f-1c0945582242 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.608244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.609192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.609569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.609886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.610897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.613540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad929b16-fce6-41eb-8d36-df2d4223f9d5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.643702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 922/1838] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:36.645384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db16475-0889-4a6c-8315-27664c745cdb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.645897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db16475-0889-4a6c-8315-27664c745cdb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.646002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db16475-0889-4a6c-8315-27664c745cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.652398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e933b799c83440b6bacb3aa096cf5c6a', 'request_id': 'req-3270e64d-7f38-47ba-be62-f765addf9061'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.660449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e933b799c83440b6bacb3aa096cf5c6a', 'request_id': 'req-3270e64d-7f38-47ba-be62-f765addf9061'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.675526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0db16475-0889-4a6c-8315-27664c745cdb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:36.678981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0db16475-0889-4a6c-8315-27664c745cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.684780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e933b799c83440b6bacb3aa096cf5c6a', 'request_id': 'req-3270e64d-7f38-47ba-be62-f765addf9061'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.699432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] The token cache is being invalidate because project e933b799c83440b6bacb3aa096cf5c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:36.699765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.700453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:36.702022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 917/1839] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:36 2022] DELETE /identity/v3/projects/e933b799c83440b6bacb3aa096cf5c6a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:36.706348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.707769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.709425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.755948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 923/1840] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:36.757215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.757509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.757783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.777752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:36.779000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.784206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270e64d-7f38-47ba-be62-f765addf9061 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.786947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 924/1841] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:36.787746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.788923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.789057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.790169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.790448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.790720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.791372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.792979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0614b-6d92-41fc-bc5a-fdc34778cbb5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.808642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 918/1842] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:36.808642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.808642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.808642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.827086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:36.828310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:36.836472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 919/1843] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:36.839979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.853086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e882d-78f6-4b83-9df6-c0b788ebe015 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.855995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1376-1ceb-4f7b-aa83-daf3278b5f3d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.857014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.857658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.857945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.858249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.860792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.861452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.861729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.861999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] PATH_INFO: `/v3/projects/682749ef6f194510b45451f00ecb74a5/users/5400bbf07dba4580bb2b9baeb4a76e4d/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.869268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.870747 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.878727 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682749ef6f194510b45451f00ecb74a5, user_id=5400bbf07dba4580bb2b9baeb4a76e4d, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.881383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.882464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 925/1844] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:36.884139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.895312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d592-4414-4951-9d2e-cf4cdb804e4d service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:36.896962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 920/1845] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:36 2022] PUT /identity/v3/projects/682749ef6f194510b45451f00ecb74a5/users/5400bbf07dba4580bb2b9baeb4a76e4d/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:36.900880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.969544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:36.970213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:36.970478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:36.971412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:36.971412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:36.971782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:36.973816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:36.978406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:36.991598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 926/1846] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:36.996569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:36.997548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b30fe-e0f2-4b8a-b755-7e452fb6ecc1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.005167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.005848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.006245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.007148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.007148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.009328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.010176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff707554-2a8f-4cbf-bee0-be28271f038f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.015848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.016638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.017199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.017354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.018166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.020191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a681c-aecb-49c9-a145-db209a114b5b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.024859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 921/1847] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:37.028766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.040231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371bc65-1815-4881-bc1b-3e443f4b960d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.045503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.046179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.046507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.046786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] PATH_INFO: `/v3/projects/682749ef6f194510b45451f00ecb74a5/users/5400bbf07dba4580bb2b9baeb4a76e4d/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.049058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682749ef6f194510b45451f00ecb74a5, user_id=5400bbf07dba4580bb2b9baeb4a76e4d, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.052223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.065582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 922/1848] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:37 2022] PUT /identity/v3/projects/682749ef6f194510b45451f00ecb74a5/users/5400bbf07dba4580bb2b9baeb4a76e4d/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:37.070131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 927/1849] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:36 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:37.072007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.075379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.075699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.076428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.119209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] MFA Rules not processed for user `5400bbf07dba4580bb2b9baeb4a76e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:37.121150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.151116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:37.168034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612046e-fcd9-4690-86d7-0610c13af641 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.241662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 928/1850] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:37.253121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.254573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.267311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.267854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.268140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.268415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.269050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.271054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.294927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 923/1851] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:37 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:37.299156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.312418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dcde5-f784-4a52-91ed-027d4777890f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.321927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.322746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.323033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.323379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.324062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.326000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.335536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd405-b2ca-4297-b7e7-0719dff1a562 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.340362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 924/1852] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:37.342659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.343315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.343527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.343759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.344255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.346256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.346617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.368825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77712fc-4cb9-4019-8386-6d664c970955 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.374191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.374830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.375109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.375391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] PATH_INFO: `/v3/projects/f768f3c9282f48189f21f2b92de23c30` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.376612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f768f3c9282f48189f21f2b92de23c30)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.378594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.419529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.420979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.431002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f768f3c9282f48189f21f2b92de23c30', 'request_id': 'req-d6ebae46-3feb-459d-b408-54e35711ffbd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.432861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:37.434257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 929/1853] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:37.438135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.442496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f768f3c9282f48189f21f2b92de23c30', 'request_id': 'req-d6ebae46-3feb-459d-b408-54e35711ffbd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.450603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35984c57-5026-4100-8070-5827c34bcd74 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.455381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f768f3c9282f48189f21f2b92de23c30', 'request_id': 'req-d6ebae46-3feb-459d-b408-54e35711ffbd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.468135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] The token cache is being invalidate because project f768f3c9282f48189f21f2b92de23c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:37.468424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.469347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.471244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 925/1854] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:37 2022] DELETE /identity/v3/projects/f768f3c9282f48189f21f2b92de23c30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:37.483092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.484656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.522824 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.523191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.523478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.523932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.524601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.526319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.541574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 930/1855] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:37.550571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.552775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.568057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6945e3-a8b7-4e29-ba55-a48b0db5ae92 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.574708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.575539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.575926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.576330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] PATH_INFO: `/v3/projects/e3c003c5286449ed910973ce3a1f1758/users/5f19ffb80dc940e6a979d1c0fc831d4c/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.580427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:37.612038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebae46-3feb-459d-b408-54e35711ffbd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.617298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c003c5286449ed910973ce3a1f1758, user_id=5f19ffb80dc940e6a979d1c0fc831d4c, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.621134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff60e-9cef-4c3f-8411-d69141ea10c8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.621298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.621929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.622314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.622590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] PATH_INFO: `/v3/users/47288e54d6704c34b924082da4e174fc` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.623915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47288e54d6704c34b924082da4e174fc)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.628151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.657709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 931/1856] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:37 2022] PUT /identity/v3/projects/e3c003c5286449ed910973ce3a1f1758/users/5f19ffb80dc940e6a979d1c0fc831d4c/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:37.659454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.659751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.660031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.698820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] MFA Rules not processed for user `5f19ffb80dc940e6a979d1c0fc831d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:37.701065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.716714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47288e54d6704c34b924082da4e174fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.740226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47288e54d6704c34b924082da4e174fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.751524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47288e54d6704c34b924082da4e174fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.752486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47288e54d6704c34b924082da4e174fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.762760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47288e54d6704c34b924082da4e174fc'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:37.778317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 926/1857] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:37 2022] DELETE /identity/v3/users/47288e54d6704c34b924082da4e174fc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:37.807807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 932/1858] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:37.809236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.811085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.827259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:37.831352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:37.944021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:37.953686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074349c2-1c1c-42ca-af4c-09f84d36274d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.955572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e2b0-fc25-4334-b9ba-c7d02481fd77 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:37.961071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.961210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:37.961843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.961963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:37.962138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.962537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.962893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:37.963179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] PATH_INFO: `/v3/users/a1c9a5c015c5426b9c9c5c1bc60224ba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:37.963543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.964528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c9a5c015c5426b9c9c5c1bc60224ba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:37.965720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:37.967144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.003569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 927/1859] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:37 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:38.009115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.038623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c9a5c015c5426b9c9c5c1bc60224ba'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.047890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c9a5c015c5426b9c9c5c1bc60224ba'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.063659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c9a5c015c5426b9c9c5c1bc60224ba'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.064419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c9a5c015c5426b9c9c5c1bc60224ba'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.069368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:38.076314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3d9f5c82-82d0-4b62-a204-91819e964253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c9a5c015c5426b9c9c5c1bc60224ba'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.085243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 933/1860] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:37 2022] DELETE /identity/v3/users/a1c9a5c015c5426b9c9c5c1bc60224ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:38.090009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.090621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.091847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.095135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed1dc-23b5-45b8-ab66-249a07517967 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.115597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:38.116976 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.169317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.170039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.170361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.170635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.171393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.173444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.199586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 928/1861] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:38 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:38.199586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.203324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.220422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b5da-95f8-4ac5-ae6a-83cdd2602c0a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.228694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.231277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.231636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.232097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] PATH_INFO: `/v3/projects/dbe974491ea04fcdab5285fe42f81e83` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.234043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe974491ea04fcdab5285fe42f81e83)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.235864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.246574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 934/1862] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:38.247621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.249313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.262293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af758-fa22-4eed-a0a2-d25ad922714b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.268882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.270445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.270445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.270816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.271751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.273510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.286389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 935/1863] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:38.287652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.290222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.296118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe974491ea04fcdab5285fe42f81e83', 'request_id': 'req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.313281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe974491ea04fcdab5285fe42f81e83', 'request_id': 'req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.323919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe974491ea04fcdab5285fe42f81e83', 'request_id': 'req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.343990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] The token cache is being invalidate because project dbe974491ea04fcdab5285fe42f81e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:38.344348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.345080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.346875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 929/1864] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:38 2022] DELETE /identity/v3/projects/dbe974491ea04fcdab5285fe42f81e83 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:38.347463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.348772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.355482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:38.370677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126459e3-e55e-4b23-9127-b4e71b933665 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.420991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d8f5-3cad-466b-a060-f39e6a9ca50e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.423205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.423922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.424293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.424680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.425656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.426284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.426562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.426667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.426832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.427481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.429072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.439097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.440190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 930/1865] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:38.440537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.441017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.442675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.450743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 936/1866] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:38.451609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.457370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02d5a8-1f11-4d44-8b7e-df2be1d171aa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.461859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec524b79-831f-40b5-b2fa-0c2e8fe5e0b3 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.462634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.463397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.463746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.464088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] PATH_INFO: `/v3/users/58e20cf1b6e44bb3b1b7b427805d57ba` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.465327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e20cf1b6e44bb3b1b7b427805d57ba)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.467170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.467476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.468027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.468378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.468761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] PATH_INFO: `/v3/projects/e36089c92bb842919fe350f014366db7/users/6724a8f8104448eda7b5babc39bd47d6/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.488104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36089c92bb842919fe350f014366db7, user_id=6724a8f8104448eda7b5babc39bd47d6, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.491375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828ff5-85b2-4d63-8a4d-afb28d9f7fc5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.507753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 937/1867] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:38 2022] PUT /identity/v3/projects/e36089c92bb842919fe350f014366db7/users/6724a8f8104448eda7b5babc39bd47d6/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:38.519935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.520235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.520701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.528294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e20cf1b6e44bb3b1b7b427805d57ba'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.545682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e20cf1b6e44bb3b1b7b427805d57ba'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.552966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] MFA Rules not processed for user `6724a8f8104448eda7b5babc39bd47d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:38.554281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e20cf1b6e44bb3b1b7b427805d57ba'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.554413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.555617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e20cf1b6e44bb3b1b7b427805d57ba'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.560006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:38.571754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e20cf1b6e44bb3b1b7b427805d57ba'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:38.578881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 931/1868] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:38 2022] DELETE /identity/v3/users/58e20cf1b6e44bb3b1b7b427805d57ba => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:38.644372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 938/1869] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:38.649550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.651183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.726752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af94d-17ad-47a1-a502-cc1bd7ceb181 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.732490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.733177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.733482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.733754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.734487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.736500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.755070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:38.770967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 932/1870] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:38 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:38.774635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.841453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a3e7c-d991-4e5d-985f-242da8d0872a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.913918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.914984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.916117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.916327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.917831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.918734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.919685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:38.924659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:38.959313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 939/1871] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:38 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:38.961176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:38.980551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ee86-f59d-44d1-9440-4c5a80b4c88b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:38.988744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:38.989459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:38.989825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:38.990253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:38.991024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:38.992856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.005593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 940/1872] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:39.006822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.010019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.036969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a900-8301-497c-b667-72a9b71330d8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.037403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195b2a2-72dc-4fed-80be-d03c78c52a7c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.041747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.042471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.042822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.043189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.045031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.045430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.046095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.046395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.046674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] PATH_INFO: `/v3/projects/c5cbe1843b5a41a4ad17ab79c51e2a45` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.048748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cbe1843b5a41a4ad17ab79c51e2a45)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.050913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.093569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:39.133361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.135120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.136375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cbe1843b5a41a4ad17ab79c51e2a45', 'request_id': 'req-24e37bb7-3ec0-4aab-9bf0-255f41fea409'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.143904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cbe1843b5a41a4ad17ab79c51e2a45', 'request_id': 'req-24e37bb7-3ec0-4aab-9bf0-255f41fea409'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.146152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 933/1873] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:39.146995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.152867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cbe1843b5a41a4ad17ab79c51e2a45', 'request_id': 'req-24e37bb7-3ec0-4aab-9bf0-255f41fea409'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.159139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567cab-41b9-4bb5-b55a-0ac390989ce4 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.168031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] The token cache is being invalidate because project c5cbe1843b5a41a4ad17ab79c51e2a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:39.168333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.169249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.173840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 941/1874] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:39 2022] DELETE /identity/v3/projects/c5cbe1843b5a41a4ad17ab79c51e2a45 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:39.173840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.173840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.226696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.228011 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.228400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.228759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] PATH_INFO: `/v3/projects/51747badaecd447786aad5f066300712/users/b45b94f181d243bf864b45e51660d0d4/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.238865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e37bb7-3ec0-4aab-9bf0-255f41fea409 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.243857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.244475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.244744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.245088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.246717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51747badaecd447786aad5f066300712, user_id=b45b94f181d243bf864b45e51660d0d4, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.246930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.249380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.268764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 934/1875] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:39 2022] PUT /identity/v3/projects/51747badaecd447786aad5f066300712/users/b45b94f181d243bf864b45e51660d0d4/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:39.268764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.270057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.306348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:39.327492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.329349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.340118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 942/1876] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:39.340954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.342349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.357730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188cb6a-3ff1-4385-8839-d29eb5b676ad service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.362809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.363563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.364019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.364390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] PATH_INFO: `/v3/users/dd464c1362aa4939ad97a73ecef75a80` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.367329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38677277-d1bd-4160-bf3c-b537f9ac2276 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.369479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd464c1362aa4939ad97a73ecef75a80)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.373282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.380700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.381463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.382004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.384447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] PATH_INFO: `/v3/projects/e4846039e3c94542a63e6fd49fa760e0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.386008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4846039e3c94542a63e6fd49fa760e0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.391088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.478608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd464c1362aa4939ad97a73ecef75a80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.494652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd464c1362aa4939ad97a73ecef75a80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.502241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:39.540725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd464c1362aa4939ad97a73ecef75a80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.541803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd464c1362aa4939ad97a73ecef75a80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.542351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4846039e3c94542a63e6fd49fa760e0', 'request_id': 'req-5fda677f-c34e-4ebf-b0fa-520da151751e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.552765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4846039e3c94542a63e6fd49fa760e0', 'request_id': 'req-5fda677f-c34e-4ebf-b0fa-520da151751e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.553375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd464c1362aa4939ad97a73ecef75a80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.570806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 943/1877] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:39 2022] DELETE /identity/v3/users/dd464c1362aa4939ad97a73ecef75a80 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:39.570806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.570806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.572927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4846039e3c94542a63e6fd49fa760e0', 'request_id': 'req-5fda677f-c34e-4ebf-b0fa-520da151751e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.608169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] The token cache is being invalidate because project e4846039e3c94542a63e6fd49fa760e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:39.608470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.610801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fda677f-c34e-4ebf-b0fa-520da151751e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:39.613716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 935/1878] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:39 2022] DELETE /identity/v3/projects/e4846039e3c94542a63e6fd49fa760e0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:39.620144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e51e-3b1a-4997-960a-3ec394686601 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.620428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e51e-3b1a-4997-960a-3ec394686601 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.620703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6e51e-3b1a-4997-960a-3ec394686601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.678514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-31f6e51e-3b1a-4997-960a-3ec394686601 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:39.679859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-31f6e51e-3b1a-4997-960a-3ec394686601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.686953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84953a6-d29b-42be-b60a-096265f2049e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.690638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 936/1879] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:39.693064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.693701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.693985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.694349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.694964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.696941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.701305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.701593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.701866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.712367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 944/1880] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:39.716681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.718563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.729935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:39.731232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.734195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a739e7-2548-4dce-a24b-731c8fe79880 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.739438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.740118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.740403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.740683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] PATH_INFO: `/v3/projects/51747badaecd447786aad5f066300712/users/b45b94f181d243bf864b45e51660d0d4/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.744790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 937/1881] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:39.744897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51747badaecd447786aad5f066300712, user_id=b45b94f181d243bf864b45e51660d0d4, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.745969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.746363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f197484-f359-4b8a-b3f3-28f5740eee95 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.759294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 945/1882] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:39 2022] PUT /identity/v3/projects/51747badaecd447786aad5f066300712/users/b45b94f181d243bf864b45e51660d0d4/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:39.759504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6211-8d7e-4d2c-b354-6a025e7ff5eb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.769600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.769867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.770199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.807982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] MFA Rules not processed for user `b45b94f181d243bf864b45e51660d0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:39.809281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.838210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.838210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.838210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.838210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.838602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:39.838602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.839779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.854759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 938/1883] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:39.860042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.872785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50371580-a81c-4e56-9726-d19834100154 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:39.878321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:39.878934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:39.879215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:39.879492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:39.880124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:39.882162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:39.904626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 946/1884] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:39.917178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 939/1885] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:39.918210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.921717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:39.922801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:39.946734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:39.993168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:40.000008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0608fec-5b7a-495f-860f-0d3da549afec None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.006515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc3c17-40cd-4414-bc4b-9e9646a7f5b8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.014715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.015371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.015653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.015928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.016717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.019164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.047497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 940/1886] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:39 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:40.047497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.049592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.063897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32032f-27da-491e-915b-de48746d3f1a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.067380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.068087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.068436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.068910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.069040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.069613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.069931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.070405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] PATH_INFO: `/v3/projects/930ee995663b4b5a84f1ce236a850d52` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.071861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=930ee995663b4b5a84f1ce236a850d52)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.073787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.141772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930ee995663b4b5a84f1ce236a850d52', 'request_id': 'req-b1711b10-c903-4cd7-93a9-b8148ac6a30e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:40.150644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930ee995663b4b5a84f1ce236a850d52', 'request_id': 'req-b1711b10-c903-4cd7-93a9-b8148ac6a30e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:40.153115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.155713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.159529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930ee995663b4b5a84f1ce236a850d52', 'request_id': 'req-b1711b10-c903-4cd7-93a9-b8148ac6a30e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:40.167869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 947/1887] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:40.168615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.173640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] The token cache is being invalidate because project 930ee995663b4b5a84f1ce236a850d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:40.174128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:40.182788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1711b10-c903-4cd7-93a9-b8148ac6a30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:40.184699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8735d8b-d2a5-48d0-be8a-5ee46017e125 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.185175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 941/1888] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:40 2022] DELETE /identity/v3/projects/930ee995663b4b5a84f1ce236a850d52 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:40.189610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729427-eaf1-4444-81b9-450a73dfff44 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.189890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729427-eaf1-4444-81b9-450a73dfff44 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.190260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729427-eaf1-4444-81b9-450a73dfff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.212238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39729427-eaf1-4444-81b9-450a73dfff44 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:40.213458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39729427-eaf1-4444-81b9-450a73dfff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.249636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.250310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.250608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.251003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.251655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.253279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.272928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 948/1889] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:40.277695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.280419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.286459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 942/1890] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:40.294637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d112666-2d68-41f0-a7cd-2ee12e35e5b3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.294823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.294977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.295393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.299445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.300053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.300339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.300634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.301295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.302951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.316340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 949/1891] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:40.318093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:40.319340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.320606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.330283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 943/1892] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:40.332499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.335261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a7540-1f83-4e04-b36c-cc86b1cba0ee admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.340919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.341590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.341879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.342221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] PATH_INFO: `/v3/projects/766267e71a1b45738ccd5fb4618c0c7b/users/45615a7d9ac145ee992e291270772e39/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.344193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a44c07-11cb-426e-9439-db03426f8564 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.350442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.351102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.351785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.351785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.353142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:40.353535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.355342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.361494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766267e71a1b45738ccd5fb4618c0c7b, user_id=45615a7d9ac145ee992e291270772e39, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.362684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce57fc-1bf8-4213-80a8-ad82a77156c4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.376126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 944/1893] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:43:40.377192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.378749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 950/1894] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:40 2022] PUT /identity/v3/projects/766267e71a1b45738ccd5fb4618c0c7b/users/45615a7d9ac145ee992e291270772e39/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:40.390875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2cf0-3439-43ef-83d5-6bc78d4392cf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.391006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.391191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.391466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.402240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:40.422132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:40.428339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] MFA Rules not processed for user `45615a7d9ac145ee992e291270772e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:40.430184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.462304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.463174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.463628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.463915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.464551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.466815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.500437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 945/1895] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:40.501961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.511632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 951/1896] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:40.525670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.527175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.582812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4fb0a-9d98-4160-a9e0-2c8657cd0283 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.588179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.589066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.589453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.589821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.590598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.593716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.611224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a5e3-6878-4af0-a689-6c26d3456438 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.631551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 946/1897] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:40.632664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.644736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd6ba-b36f-491a-a347-4d98e3cfb933 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.659834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.660469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.660749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.661021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.661676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.663318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.682111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 947/1898] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:40.685862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.686854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.687527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.687813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.688091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.702282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70288d7-f797-4274-8eb5-80ea00876bb3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.718663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.719392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.719668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.719922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.720569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.722235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.735082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 948/1899] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:40.739437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:40.751419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1c99-f45e-4505-8d2f-8ab540702420 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:40.756457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:40.757150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.757439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.757715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] PATH_INFO: `/v3/projects/e3a80ec3647f44d89a194d1ea7edf0c0/users/012f0aa8587d453693791ccbbc032e11/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.779377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.780224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a80ec3647f44d89a194d1ea7edf0c0, user_id=012f0aa8587d453693791ccbbc032e11, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:40.781363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e486-cdef-4bf8-86f7-05f787c41d18 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.783106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:40.793564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 952/1900] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:40.805473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 949/1901] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:40 2022] PUT /identity/v3/projects/e3a80ec3647f44d89a194d1ea7edf0c0/users/012f0aa8587d453693791ccbbc032e11/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:40.816927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:40.817352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:40.817731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:40.885132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:40.885132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] MFA Rules not processed for user `012f0aa8587d453693791ccbbc032e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:40.885729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:40.969140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 953/1902] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:40.973489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.015171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.017190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:41.027952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:41.052890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606a1a-e811-4ceb-b44c-7c5f442c441a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.059968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.060623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.061175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.061175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.062463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.063843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.105887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 950/1903] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:40 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:41.109788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.125817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f46b20-19ec-4cfa-a357-c3cb42bc4334 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.195898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.196522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.196808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.197082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.198994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:41.214915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb71d5-a544-42dc-bec5-d290253341be admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.223202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.224009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.224293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.224564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.225204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.229537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.266156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 951/1904] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:41 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:41.267792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.278943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3725e7a-9a33-41bd-a5a0-d64434755646 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.281900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.284970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.286219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.286891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.287404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.288186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.288381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.290830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.296496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 954/1905] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:41.314106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 952/1906] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:41.317694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.337859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0784b4f-b3b5-48ed-a31f-e70ce3ffc6b0 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.344504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.346274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.346656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.347094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] PATH_INFO: `/v3/projects/7b8a3f6dc9174e17a82f384b6646691e/users/9a2d9305b30c42d68f6a14c71db76ed5/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.378702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:41.393515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8a3f6dc9174e17a82f384b6646691e, user_id=9a2d9305b30c42d68f6a14c71db76ed5, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.393515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.419595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 955/1907] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:41 2022] PUT /identity/v3/projects/7b8a3f6dc9174e17a82f384b6646691e/users/9a2d9305b30c42d68f6a14c71db76ed5/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:41.423349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.437408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559708b-4304-4a75-87ef-fb492f894eaf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.520794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.521408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.522342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.522634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.523291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.525478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9e00a-24dc-454f-95a1-2ba6d7b3c98c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.537520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 953/1908] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:41.542904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.558950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fc5d6-38b7-4c0b-836e-7fac5875e696 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.564558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.565241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.565522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.565797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] PATH_INFO: `/v3/projects/7b8a3f6dc9174e17a82f384b6646691e/users/9a2d9305b30c42d68f6a14c71db76ed5/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.567904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8a3f6dc9174e17a82f384b6646691e, user_id=9a2d9305b30c42d68f6a14c71db76ed5, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.570986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.582566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 956/1909] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:41 2022] PUT /identity/v3/projects/7b8a3f6dc9174e17a82f384b6646691e/users/9a2d9305b30c42d68f6a14c71db76ed5/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:41.594059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af966-2f6d-4f55-975b-1d29b8654822 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.594059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af966-2f6d-4f55-975b-1d29b8654822 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.594459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0af966-2f6d-4f55-975b-1d29b8654822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.624427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fc0af966-2f6d-4f55-975b-1d29b8654822 None None] MFA Rules not processed for user `9a2d9305b30c42d68f6a14c71db76ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:41.625661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fc0af966-2f6d-4f55-975b-1d29b8654822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:41.666281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:41.743763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 954/1910] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:41.755983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:41.826035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27bbac-ed3b-4115-9504-f893122825ed admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:41.829911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:41.830675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:41.831024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:41.831375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:41.931987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:41.933426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c5e2-3267-4440-807a-c95a7eded86a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:41.943383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 957/1911] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:44.586794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:44.587290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:44.587290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:44.588607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 955/1912] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:43:44.610396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:44.616929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:44.617075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:44.676493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:44.677763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:44.905362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 958/1913] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:44.929254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:44.931439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:44.980062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82797f-c624-4360-a8b2-88a8562a01ae None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:44.994962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:44.995595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:44.996033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:44.996172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:45.027431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:45.030123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d620f-bf22-4188-898d-502c58fbf203 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:45.052959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:45.054391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 956/1914] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:45.057042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:45.150289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:45.299291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b9a8b-8d6a-468c-a5a4-09d33464abec None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:45.311788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:45.312454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:45.312740 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:45.313017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] PATH_INFO: `/v3/users/bb3aa6f2baf846338217e02a960ae116` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:45.314249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3aa6f2baf846338217e02a960ae116)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:45.316342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:45.459276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3aa6f2baf846338217e02a960ae116'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:45.477472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3aa6f2baf846338217e02a960ae116'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:45.518026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3aa6f2baf846338217e02a960ae116'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:45.521684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3aa6f2baf846338217e02a960ae116'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:45.540483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3aa6f2baf846338217e02a960ae116'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:45.549726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 959/1915] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:45 2022] DELETE /identity/v3/users/bb3aa6f2baf846338217e02a960ae116 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:45.555518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:45.556119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:45.556593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:45.584429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:45.585940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:45.740594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 957/1916] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:45.768909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:45.770604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:45.861799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b3fa6-cbb9-448d-af1c-1990e4fc76ef admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:45.869506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:45.870760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:45.871226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:45.871693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:45.887012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:45.889168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:45.902686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 960/1917] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:45.987182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:45.989450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:46.063236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50010d2-c036-4275-97a1-e81759b5460f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:46.067057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:46.067777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:46.068432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:46.068432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:46.070261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:46.171813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:46.173430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:46.186176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 958/1918] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:46.507010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:46.509185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:46.535473 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b67d-368c-4db7-b88a-ce70236c5007 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:46.546974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:46.548634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:46.550458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:46.551043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] PATH_INFO: `/v3/projects/22ac81d9f88d4390a56de05805ac329b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:46.556662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ac81d9f88d4390a56de05805ac329b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:46.559297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:46.665687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:46.681486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ac81d9f88d4390a56de05805ac329b', 'request_id': 'req-af9fbf1a-ef80-4872-a695-ba450773fade'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:46.691644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ac81d9f88d4390a56de05805ac329b', 'request_id': 'req-af9fbf1a-ef80-4872-a695-ba450773fade'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:46.704954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ac81d9f88d4390a56de05805ac329b', 'request_id': 'req-af9fbf1a-ef80-4872-a695-ba450773fade'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:46.721690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] The token cache is being invalidate because project 22ac81d9f88d4390a56de05805ac329b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:46.721946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:46.724149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:46.728681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 961/1919] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:46 2022] DELETE /identity/v3/projects/22ac81d9f88d4390a56de05805ac329b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:46.732659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:46.750306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e9be4-3eff-4f30-8c76-6f7c4b703ce6 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:46.769503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:46.871151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:46.873500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:46.874123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:46.874527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] PATH_INFO: `/v3/users/5400bbf07dba4580bb2b9baeb4a76e4d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:46.891412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5400bbf07dba4580bb2b9baeb4a76e4d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:46.893956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:47.003622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5400bbf07dba4580bb2b9baeb4a76e4d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.006535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:47.009313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:47.035278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5400bbf07dba4580bb2b9baeb4a76e4d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.053736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5400bbf07dba4580bb2b9baeb4a76e4d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.055482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5400bbf07dba4580bb2b9baeb4a76e4d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.074252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5400bbf07dba4580bb2b9baeb4a76e4d'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.099906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 959/1920] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:46 2022] DELETE /identity/v3/users/5400bbf07dba4580bb2b9baeb4a76e4d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:47.160419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fbf1a-ef80-4872-a695-ba450773fade admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:47.251449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:47.252293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:47.252584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:47.252865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:47.256099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:47.386337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:47.387837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:47.404745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 962/1921] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:47.549766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:47.551294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:47.714877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264d179-92a3-4891-b5f2-a6c8ee5fa3a6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:47.720651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:47.721334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:47.721963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:47.722056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] PATH_INFO: `/v3/users/45615a7d9ac145ee992e291270772e39` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:47.723211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45615a7d9ac145ee992e291270772e39)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:47.728303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:47.799075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:47.842590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45615a7d9ac145ee992e291270772e39'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.893200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45615a7d9ac145ee992e291270772e39'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.908410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:47.910119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:47.936203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45615a7d9ac145ee992e291270772e39'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.939553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45615a7d9ac145ee992e291270772e39'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.958582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963a74-2a91-4675-b442-3920e9345862 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:47.972596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e32ecf4a-ae36-45c0-947f-023f97e3067e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45615a7d9ac145ee992e291270772e39'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:47.979224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:47.980144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:47.981877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:47.982179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] PATH_INFO: `/v3/projects/682749ef6f194510b45451f00ecb74a5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:47.984229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 960/1922] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:47 2022] DELETE /identity/v3/users/45615a7d9ac145ee992e291270772e39 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:47.988622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:47.989617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:47.990317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=682749ef6f194510b45451f00ecb74a5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:47.990412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:47.996484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.044177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:48.045991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.076835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:48.115860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682749ef6f194510b45451f00ecb74a5', 'request_id': 'req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:48.130106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682749ef6f194510b45451f00ecb74a5', 'request_id': 'req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:48.153739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682749ef6f194510b45451f00ecb74a5', 'request_id': 'req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:48.179342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] The token cache is being invalidate because project 682749ef6f194510b45451f00ecb74a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:48.180246 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:48.182030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-356b6c6c-949f-4fde-a02b-bc4dc57a41eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:48.184179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 963/1923] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:47 2022] DELETE /identity/v3/projects/682749ef6f194510b45451f00ecb74a5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:48.191215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cb19-e4e1-4e39-bd4e-feb7830a3ea1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.191765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cb19-e4e1-4e39-bd4e-feb7830a3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.192276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4cb19-e4e1-4e39-bd4e-feb7830a3ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.215337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-52b4cb19-e4e1-4e39-bd4e-feb7830a3ea1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:48.216635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-52b4cb19-e4e1-4e39-bd4e-feb7830a3ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.233115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 961/1924] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:48.244562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.246219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.294630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 964/1925] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:48.302591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.302909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.303155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.315442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e2d93-6b92-483d-aabf-e1735e6b6438 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.324608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:48.325846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.333781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 965/1926] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:48.338303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.347607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532ee0d-4862-4ad9-99f6-cb72b2e34c86 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.352338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.352951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.353231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.353503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.354188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:48.354504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.356095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.367899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.368666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.369049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 966/1927] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:48.369181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.369475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.373539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.379905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.381892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.385410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47ab9-6da3-432b-9acb-e8b149edccc8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.391741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.392364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.392757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.392975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.393555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.395601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 962/1928] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:48.396159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.427917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 967/1929] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:48.432984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.449094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:48.452595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a721-7146-4448-8114-6cb375bfd792 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.543800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.544424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.544696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.544966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.546121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.548058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.572757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 963/1930] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:48.576900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.591424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257e7e2-7eb4-4ecc-819e-d1d2742c25fe admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.596840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.597466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.597748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.598024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.598957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.600530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.618284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 968/1931] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:48.622858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.634759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11387332-b3ea-4ce8-87e7-9e59e5df7acd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.640467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.641386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.641658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.641927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.642694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.644394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfd585-b2a6-4883-a231-d56fe352bf57 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.656685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 964/1932] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:48.660787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.672448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9ca6c-28fa-474e-a7a8-ad10058786fd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.678622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.679268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.679623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.680418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] PATH_INFO: `/v3/projects/f325d8886d5e42678cd4fcea21f8bfdd/users/a2764ace7fc64d2cb497085e8479b2c8/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.699720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f325d8886d5e42678cd4fcea21f8bfdd, user_id=a2764ace7fc64d2cb497085e8479b2c8, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.701785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.718108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 969/1933] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:48 2022] PUT /identity/v3/projects/f325d8886d5e42678cd4fcea21f8bfdd/users/a2764ace7fc64d2cb497085e8479b2c8/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:48.729782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.730085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.730528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.762775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] MFA Rules not processed for user `a2764ace7fc64d2cb497085e8479b2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:48.765778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.777099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.779244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:48.871413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:48.897191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 965/1934] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:48.902100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:48.912792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a6d77-3d54-4262-ba7d-abc79b72a5c3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.928030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.928698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.929271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.930230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] PATH_INFO: `/v3/projects/766267e71a1b45738ccd5fb4618c0c7b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.931611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766267e71a1b45738ccd5fb4618c0c7b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.931765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9d2b9-fd52-481a-af8f-4a7fffaba5b7 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:48.934649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:48.945495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:48.946155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:48.946440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:48.946711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:48.947343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:48.949441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.011831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 966/1935] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:48 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:49.016158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.046667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766267e71a1b45738ccd5fb4618c0c7b', 'request_id': 'req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.065043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766267e71a1b45738ccd5fb4618c0c7b', 'request_id': 'req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.081333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766267e71a1b45738ccd5fb4618c0c7b', 'request_id': 'req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.113223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] The token cache is being invalidate because project 766267e71a1b45738ccd5fb4618c0c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:49.113664 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.115127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5f7e354c-97ac-4ed7-b47f-fd904da05cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.123221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 970/1936] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:48 2022] DELETE /identity/v3/projects/766267e71a1b45738ccd5fb4618c0c7b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:49.124985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6d64-1c7c-40c4-88e1-7b682c925e4c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.125094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6d64-1c7c-40c4-88e1-7b682c925e4c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.125372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab6d64-1c7c-40c4-88e1-7b682c925e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.131620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:49.145575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d98b9-663f-4b3c-a932-20855fba5c31 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.152182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.152997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.153380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.153937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.154736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.156858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.170962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-abab6d64-1c7c-40c4-88e1-7b682c925e4c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:49.172278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-abab6d64-1c7c-40c4-88e1-7b682c925e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.181899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 967/1937] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:49.186042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.188322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.191779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 971/1938] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:49.202001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.202324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.202606 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.204137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a3a5a-bf9d-4af3-bd2c-00584592a071 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.209544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.210380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.211550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.211967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.212868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.214778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.231374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:49.235322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.243748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 968/1939] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:49.251275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 972/1940] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:49.255525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.256371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.267834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea45b-1e6a-4b76-84c0-cbffb9305edc None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.273958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.274741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.275027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.275395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.276381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:49.276697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.278551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.302970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 973/1941] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:43:49.307170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.307596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d62d69-8c1d-47d7-96e3-db8e3ea0788b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.326242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3cb10-e342-4364-83ad-8824458d7856 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.332049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.333012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.333437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.333965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] PATH_INFO: `/v3/projects/b63a74888612433f88e88417cac93fd2/users/e4bff9edf8954dc29480a359b03b80ed/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.350931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.352536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.352922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.353302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.354042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.356111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.375979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63a74888612433f88e88417cac93fd2, user_id=e4bff9edf8954dc29480a359b03b80ed, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.380370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.403290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 969/1942] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:49 2022] PUT /identity/v3/projects/b63a74888612433f88e88417cac93fd2/users/e4bff9edf8954dc29480a359b03b80ed/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:49.407405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.414305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 974/1943] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:49.417351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.555467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38ddbc-5b32-4103-adf1-1ecb7d8ddc40 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.561675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8374d2-bd58-400a-92b8-982e35127eb5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.564643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.565722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.566271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.568852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.568852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.572838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.573677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.575320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.577581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.578029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.579712 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.587852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.591179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 970/1944] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:49.596386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.609751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184c58a-83a1-4fe6-9286-1da34a3b2a40 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.616098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.616961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.617544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 975/1945] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:49.622140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.622549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] PATH_INFO: `/v3/projects/b63a74888612433f88e88417cac93fd2/users/e4bff9edf8954dc29480a359b03b80ed/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.623293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.625269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63a74888612433f88e88417cac93fd2, user_id=e4bff9edf8954dc29480a359b03b80ed, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.628323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2e9f2-b4ef-4cce-8100-9120dd2bb1b6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.636882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aab91-f231-45e7-9d5b-41d8e7ad75ea admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.647445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 971/1946] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:49 2022] PUT /identity/v3/projects/b63a74888612433f88e88417cac93fd2/users/e4bff9edf8954dc29480a359b03b80ed/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:49.647742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:49.665562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.665562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.665910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.712895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] MFA Rules not processed for user `e4bff9edf8954dc29480a359b03b80ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:49.714209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.783737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.784514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.784810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.785417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.787850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.790525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.807045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 976/1947] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:49.808467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.814639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.834183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b6b6-b035-4865-9811-a771690103d2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.840061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.840852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.841236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.841518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] PATH_INFO: `/v3/users/5f19ffb80dc940e6a979d1c0fc831d4c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.842715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f19ffb80dc940e6a979d1c0fc831d4c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.844671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.852083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 972/1948] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:49.853086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.865433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939763c0-a02e-43a6-baa1-84f4a43f0fe4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:49.871017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:49.871628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:49.871901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:49.872167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:49.872808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:49.874469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:49.886301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 973/1949] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:49.890876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.892724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.900648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:49.911228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f19ffb80dc940e6a979d1c0fc831d4c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.924733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f19ffb80dc940e6a979d1c0fc831d4c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.940163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f19ffb80dc940e6a979d1c0fc831d4c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.941568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f19ffb80dc940e6a979d1c0fc831d4c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.952035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f19ffb80dc940e6a979d1c0fc831d4c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:49.959330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 977/1950] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:49 2022] DELETE /identity/v3/users/5f19ffb80dc940e6a979d1c0fc831d4c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:49.962552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:49.962552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:49.970487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65183aed-0cfc-4596-acd9-2afb5c019e02 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:50.025964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:50.026886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.027170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.027446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.029278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:50.032887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396f6e-58ae-4186-80df-934efcc16dfb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:50.046211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:50.048853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.048853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.048853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] PATH_INFO: `/v3/projects/4631389703144e1e818700ddbe94a183/users/4561c65d482642e687339cdb13a57828/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.071330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4631389703144e1e818700ddbe94a183, user_id=4561c65d482642e687339cdb13a57828, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:50.074054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e87f4a-93c9-4f1b-a5bf-2eae830fade3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:50.103762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 978/1951] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:49 2022] PUT /identity/v3/projects/4631389703144e1e818700ddbe94a183/users/4561c65d482642e687339cdb13a57828/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:50.105947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.106336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.106688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.114548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:50.133843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:50.137062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:50.140347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:50.142658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e807c9-04b8-4134-9dec-63fda1bd6a7c service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:50.153660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 974/1952] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:50.166611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.168063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.168436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.220300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] MFA Rules not processed for user `4561c65d482642e687339cdb13a57828`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:50.221683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:50.238300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 979/1953] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:50.246909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:50.258121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:50.329903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:50.337342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 975/1954] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:50.348790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:50.350883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:50.353063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3057-6824-428f-ba9b-7f0be13cd710 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:50.363929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:50.364772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.369139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.369532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.389417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:50.391641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:50.410816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 980/1955] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:50.445769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0111-15ff-4bbd-8483-d0cf66c3d920 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:50.451780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:50.452508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.452861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.453209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.466871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:50.469726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:50.485828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 976/1956] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:50.759409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:50.979584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8832a9-c09c-4ed3-9a0c-663e38a51441 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:50.986251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4bff9edf8954dc29480a359b03b80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b63a74888612433f88e88417cac93fd2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:50.988299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:50.988753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:50.989201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:50.989946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:50.990374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:50.992524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.014281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 981/1957] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:51.018139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.032254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826718-0b08-4abe-bdbc-460597bce507 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.053048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4bff9edf8954dc29480a359b03b80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b63a74888612433f88e88417cac93fd2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.053687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.054031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.054400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.055116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.057842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.112277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 977/1958] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:51 2022] POST /identity/v3/projects => generated 354 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:51.116438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.127001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50bb0d-39ea-48ad-b22c-7ff69e1daf9e tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.180106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:51.200818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4bff9edf8954dc29480a359b03b80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b63a74888612433f88e88417cac93fd2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.201542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.201891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.202266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.203015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:51.203327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.204918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.217774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 982/1959] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:43:51.243361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.245832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:51.266982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.277523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d43e4-206c-4814-bbc0-a6c9f8d1b5c3 tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.282812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4bff9edf8954dc29480a359b03b80ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b63a74888612433f88e88417cac93fd2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.283464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.284050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.284335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] PATH_INFO: `/v3/projects/0870c8c42f024467a8de1a239425033f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.285493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0870c8c42f024467a8de1a239425033f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.287525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.332279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4d42-5112-4fa4-b831-a4cebc9fb5ac tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.344716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0870c8c42f024467a8de1a239425033f', 'request_id': 'req-44eda47d-0097-4831-b5fc-92187475183c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.353740 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0870c8c42f024467a8de1a239425033f', 'request_id': 'req-44eda47d-0097-4831-b5fc-92187475183c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.363881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0870c8c42f024467a8de1a239425033f', 'request_id': 'req-44eda47d-0097-4831-b5fc-92187475183c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.385613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] The token cache is being invalidate because project 0870c8c42f024467a8de1a239425033f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:51.386280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.387282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.389029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 983/1960] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:51 2022] DELETE /identity/v3/projects/0870c8c42f024467a8de1a239425033f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:51.416892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.417670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.418016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.418505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] PATH_INFO: `/v3/projects/e3c003c5286449ed910973ce3a1f1758` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.420166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c003c5286449ed910973ce3a1f1758)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.421740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.462848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:51.483526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c003c5286449ed910973ce3a1f1758', 'request_id': 'req-47fb4882-787a-4bcb-bd9c-5868befef4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.490344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c003c5286449ed910973ce3a1f1758', 'request_id': 'req-47fb4882-787a-4bcb-bd9c-5868befef4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.500153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c003c5286449ed910973ce3a1f1758', 'request_id': 'req-47fb4882-787a-4bcb-bd9c-5868befef4e4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.514744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] The token cache is being invalidate because project e3c003c5286449ed910973ce3a1f1758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:51.515042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.515730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.517278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 978/1961] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:51 2022] DELETE /identity/v3/projects/e3c003c5286449ed910973ce3a1f1758 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:51.521510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.529035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:51.537707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eda47d-0097-4831-b5fc-92187475183c tempest-VolumeQuotaClassesTest-1840068590 tempest-VolumeQuotaClassesTest-1840068590-project-admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.605853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.606561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.606886 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.607168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] PATH_INFO: `/v3/users/6724a8f8104448eda7b5babc39bd47d6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.608492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6724a8f8104448eda7b5babc39bd47d6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.613624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.644098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:51.646827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:51.661407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb4882-787a-4bcb-bd9c-5868befef4e4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:51.672249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:51.673007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.673799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.674309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] PATH_INFO: `/v3/users/a2764ace7fc64d2cb497085e8479b2c8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.676074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2764ace7fc64d2cb497085e8479b2c8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:51.678203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:51.684781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6724a8f8104448eda7b5babc39bd47d6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.691631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6724a8f8104448eda7b5babc39bd47d6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.699270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:51.709764 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6724a8f8104448eda7b5babc39bd47d6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.711285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6724a8f8104448eda7b5babc39bd47d6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.726271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-69ebaee5-510e-4bc3-a3da-a21b9f544773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6724a8f8104448eda7b5babc39bd47d6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.736858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 984/1962] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:51 2022] DELETE /identity/v3/users/6724a8f8104448eda7b5babc39bd47d6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:51.760128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2764ace7fc64d2cb497085e8479b2c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.782675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2764ace7fc64d2cb497085e8479b2c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.796399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2764ace7fc64d2cb497085e8479b2c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.798674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2764ace7fc64d2cb497085e8479b2c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.816821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2764ace7fc64d2cb497085e8479b2c8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:51.827301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 979/1963] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:51 2022] DELETE /identity/v3/users/a2764ace7fc64d2cb497085e8479b2c8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:43:51.832048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:51.832313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:51.832624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:51.881709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:51.883742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:51.998586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 985/1964] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:52.017314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:52.019398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:52.115461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082e42c-4876-4c3f-908d-fff4429e78f9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:52.119832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:52.120600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:52.121124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:52.121465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:52.138992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:52.141369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:52.156076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 980/1965] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:52.270783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:52.274206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:52.295709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5c47d-57e9-4b82-aae5-ddb08ebfb943 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:52.304259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:52.305428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:52.305428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:52.305775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] PATH_INFO: `/v3/projects/e36089c92bb842919fe350f014366db7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:52.308310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36089c92bb842919fe350f014366db7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:52.312068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:52.436371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36089c92bb842919fe350f014366db7', 'request_id': 'req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.443608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36089c92bb842919fe350f014366db7', 'request_id': 'req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.453096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36089c92bb842919fe350f014366db7', 'request_id': 'req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.472453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] The token cache is being invalidate because project e36089c92bb842919fe350f014366db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:52.472855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.473722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.478341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 986/1966] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:52 2022] DELETE /identity/v3/projects/e36089c92bb842919fe350f014366db7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:52.483965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:52.497375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7560-e34b-4d95-b4bc-3446c06738d0 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:52.551142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:52.596465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:52.597396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:52.597770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:52.598176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] PATH_INFO: `/v3/users/b45b94f181d243bf864b45e51660d0d4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:52.599463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45b94f181d243bf864b45e51660d0d4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:52.601791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:52.665218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45b94f181d243bf864b45e51660d0d4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.685205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45b94f181d243bf864b45e51660d0d4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.685842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:52.690758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:52.706476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5364d-3935-4024-b8d4-2ee30e7e89a7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:52.707254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45b94f181d243bf864b45e51660d0d4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.708042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45b94f181d243bf864b45e51660d0d4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.714401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:52.716124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:52.716536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:52.716994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] PATH_INFO: `/v3/projects/f325d8886d5e42678cd4fcea21f8bfdd` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:52.717762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45b94f181d243bf864b45e51660d0d4'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.729296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 981/1967] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:52 2022] DELETE /identity/v3/users/b45b94f181d243bf864b45e51660d0d4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:52.729406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f325d8886d5e42678cd4fcea21f8bfdd)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:52.730393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:52.794141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f325d8886d5e42678cd4fcea21f8bfdd', 'request_id': 'req-1c63f842-959f-407a-95d5-8bbd32767bc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.806642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f325d8886d5e42678cd4fcea21f8bfdd', 'request_id': 'req-1c63f842-959f-407a-95d5-8bbd32767bc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.808931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:52.819515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f325d8886d5e42678cd4fcea21f8bfdd', 'request_id': 'req-1c63f842-959f-407a-95d5-8bbd32767bc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.849313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] The token cache is being invalidate because project f325d8886d5e42678cd4fcea21f8bfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:52.849477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.850251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:52.855987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 987/1968] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:52 2022] DELETE /identity/v3/projects/f325d8886d5e42678cd4fcea21f8bfdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:52.860060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:52.861577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:52.969368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40a79f-9d74-4a69-aa5c-34540caec973 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.057068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:53.063120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.063751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.064313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.064593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] PATH_INFO: `/v3/users/e4bff9edf8954dc29480a359b03b80ed` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.066555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bff9edf8954dc29480a359b03b80ed)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.068891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.084216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.086015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.131196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63f842-959f-407a-95d5-8bbd32767bc4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.143366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.144254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.144558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.145254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] PATH_INFO: `/v3/projects/51747badaecd447786aad5f066300712` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.146973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51747badaecd447786aad5f066300712)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.149934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.171019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bff9edf8954dc29480a359b03b80ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.194444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bff9edf8954dc29480a359b03b80ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.207356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bff9edf8954dc29480a359b03b80ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.208353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bff9edf8954dc29480a359b03b80ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.219565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bff9edf8954dc29480a359b03b80ed'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.224006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51747badaecd447786aad5f066300712', 'request_id': 'req-79cc8df2-ce96-44ed-a280-a2af21724372'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.228235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 982/1969] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:52 2022] DELETE /identity/v3/users/e4bff9edf8954dc29480a359b03b80ed => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:53.229371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.231259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.243324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51747badaecd447786aad5f066300712', 'request_id': 'req-79cc8df2-ce96-44ed-a280-a2af21724372'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.256376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51747badaecd447786aad5f066300712', 'request_id': 'req-79cc8df2-ce96-44ed-a280-a2af21724372'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.274752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] The token cache is being invalidate because project 51747badaecd447786aad5f066300712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:53.275374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.276507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-79cc8df2-ce96-44ed-a280-a2af21724372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.278943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 988/1970] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:53 2022] DELETE /identity/v3/projects/51747badaecd447786aad5f066300712 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:53.285968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b407-18a9-4f2e-8d9a-d8c62486e7c9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.286511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b407-18a9-4f2e-8d9a-d8c62486e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.287561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576b407-18a9-4f2e-8d9a-d8c62486e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.338112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0576b407-18a9-4f2e-8d9a-d8c62486e7c9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:53.338112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0576b407-18a9-4f2e-8d9a-d8c62486e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.357477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbbd9e-b895-45dd-82bd-a31546faf3e9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.362932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.363593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.363868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.364136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] PATH_INFO: `/v3/users/012f0aa8587d453693791ccbbc032e11` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.365496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012f0aa8587d453693791ccbbc032e11)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.368116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.443696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012f0aa8587d453693791ccbbc032e11'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.458169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 989/1971] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:53.460308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.460308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.460532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.485709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012f0aa8587d453693791ccbbc032e11'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.495343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012f0aa8587d453693791ccbbc032e11'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.496949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012f0aa8587d453693791ccbbc032e11'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.499358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:53.501668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:53.503067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.508905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab42ba7d-c7dd-41bc-b441-f76ca71f61d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012f0aa8587d453693791ccbbc032e11'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:53.520371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 983/1972] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:53 2022] DELETE /identity/v3/users/012f0aa8587d453693791ccbbc032e11 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:53.524956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.525525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.526933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.527088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 990/1973] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:53.531207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.549085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b770-8ebf-4f72-b0fc-9c205eb47e9f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.556179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:53.557644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.649629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.650428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.650913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.651018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.651650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:53.651985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.654823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.657426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:53.659621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 984/1974] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:43:53.678385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 991/1975] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:53.679728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.681338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.683307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.693284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4245009-9cb0-4389-a987-3f6996646c8f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.716793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.717980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.717980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.718389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.718963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.721095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.766794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2083a-68dc-4a89-b5dd-c13dc5102004 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.770807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.771522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.771883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.772219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.775278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 992/1976] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:53 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:43:53.780201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.783680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.785184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.786683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:53.796936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 985/1977] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:43:53.797807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.809499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca865aa6-748b-4471-9ea9-f2c6a512f0c6 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.923450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faaf982-9dc8-4b6a-aefd-55d9fb4cc762 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:53.932866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.933786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.934086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.934419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] PATH_INFO: `/v3/projects/b63a74888612433f88e88417cac93fd2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.935738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63a74888612433f88e88417cac93fd2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.938459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.938859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:53.939476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:53.939750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:53.940017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:53.940854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:53.943014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:53.976838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 986/1978] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:53 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:53.978506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:53.991025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed794f5-4e61-4994-9978-aaec02a2c176 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.006029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63a74888612433f88e88417cac93fd2', 'request_id': 'req-49e787fa-a03b-468c-8767-fd1f185b1fe9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.016993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63a74888612433f88e88417cac93fd2', 'request_id': 'req-49e787fa-a03b-468c-8767-fd1f185b1fe9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.024297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:54.032756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63a74888612433f88e88417cac93fd2', 'request_id': 'req-49e787fa-a03b-468c-8767-fd1f185b1fe9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.050875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] The token cache is being invalidate because project b63a74888612433f88e88417cac93fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:54.051447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.051945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.053691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 993/1979] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:53 2022] DELETE /identity/v3/projects/b63a74888612433f88e88417cac93fd2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:54.060547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.061867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.070429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.070429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.070429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.070429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.071186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.072030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274d631-a9d0-48fa-b942-05c91235cf00 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.082267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 987/1980] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:54.083853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.084231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.084512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.107716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:54.108978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.118680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 988/1981] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:54.120014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.121556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.138306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510209e-12cf-4f0a-b04c-cf24b4595fcc None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.144207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.144754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.145039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.145317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.145982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.147711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4947a-4688-4038-9f2a-dda42bd10b3e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.156313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e787fa-a03b-468c-8767-fd1f185b1fe9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.166660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.167892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.168393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.168869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] PATH_INFO: `/v3/users/4561c65d482642e687339cdb13a57828` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.174222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 989/1982] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:54.174401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4561c65d482642e687339cdb13a57828)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.174494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.174611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.174841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.175117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.180278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:54.200763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:54.202129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.216986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 990/1983] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:54.217799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.219284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.235629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83cd99-ffea-43f4-ad08-eb28b0c1b708 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.242604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.243309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.243677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.243944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] PATH_INFO: `/v3/users/3d132888f62e4a11a9e3a7c34c0b1c13` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.245295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4561c65d482642e687339cdb13a57828'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.245489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d132888f62e4a11a9e3a7c34c0b1c13)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.247402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.255002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4561c65d482642e687339cdb13a57828'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.271746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4561c65d482642e687339cdb13a57828'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.272861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4561c65d482642e687339cdb13a57828'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.287234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4561c65d482642e687339cdb13a57828'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.294882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 994/1984] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:54 2022] DELETE /identity/v3/users/4561c65d482642e687339cdb13a57828 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:54.298316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.298316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.314530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d132888f62e4a11a9e3a7c34c0b1c13'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.330650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d132888f62e4a11a9e3a7c34c0b1c13'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.338519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d132888f62e4a11a9e3a7c34c0b1c13'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.339270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d132888f62e4a11a9e3a7c34c0b1c13'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.351057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d132888f62e4a11a9e3a7c34c0b1c13'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.358321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 991/1985] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:54 2022] DELETE /identity/v3/users/3d132888f62e4a11a9e3a7c34c0b1c13 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:54.359317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.360872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.390195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd109-f2a2-45a2-af0d-49350e583d17 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.488763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347db43-1476-498f-955f-d6c322da91c4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.498025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.500979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.501264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.501541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] PATH_INFO: `/v3/projects/d39431c15a2245b49f654dec31aa4e27/users/d83949fa7fee47e8989b775be05f610f/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.504650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.506061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.506503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.506796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.508221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:54.508221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.510113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.523641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39431c15a2245b49f654dec31aa4e27, user_id=d83949fa7fee47e8989b775be05f610f, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.524237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 992/1986] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:54.525039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.527826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b521-69d3-4da2-a2b7-b4b4b5a8b316 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.528369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.545737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7ac2-132c-4839-9eba-e1a771fe1424 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.551774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:54.562165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 995/1987] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:54 2022] PUT /identity/v3/projects/d39431c15a2245b49f654dec31aa4e27/users/d83949fa7fee47e8989b775be05f610f/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:54.562165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3237ca-c37b-4ec9-a5ad-fbc14e4d2bc8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.562165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3237ca-c37b-4ec9-a5ad-fbc14e4d2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.562165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3237ca-c37b-4ec9-a5ad-fbc14e4d2bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.595043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2b3237ca-c37b-4ec9-a5ad-fbc14e4d2bc8 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:54.597035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2b3237ca-c37b-4ec9-a5ad-fbc14e4d2bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.613544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:54.637857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.638707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.638995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.639276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] PATH_INFO: `/v3/projects/e3a80ec3647f44d89a194d1ea7edf0c0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.640499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a80ec3647f44d89a194d1ea7edf0c0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.642475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.711417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a80ec3647f44d89a194d1ea7edf0c0', 'request_id': 'req-b033d846-2aed-44d2-a45b-27db77ba4515'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.725454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a80ec3647f44d89a194d1ea7edf0c0', 'request_id': 'req-b033d846-2aed-44d2-a45b-27db77ba4515'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.738574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 996/1988] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:54.742697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a80ec3647f44d89a194d1ea7edf0c0', 'request_id': 'req-b033d846-2aed-44d2-a45b-27db77ba4515'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.742872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df89-a596-4d06-92e2-d9be996b568d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.742872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df89-a596-4d06-92e2-d9be996b568d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.743538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3df89-a596-4d06-92e2-d9be996b568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.759489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] The token cache is being invalidate because project e3a80ec3647f44d89a194d1ea7edf0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:54.759976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.760854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:54.762979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 993/1989] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:54 2022] DELETE /identity/v3/projects/e3a80ec3647f44d89a194d1ea7edf0c0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:54.764437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.766045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.768998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-76b3df89-a596-4d06-92e2-d9be996b568d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:54.770555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76b3df89-a596-4d06-92e2-d9be996b568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.864045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 997/1990] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:54.865527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.865921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.866341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.885823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d846-2aed-44d2-a45b-27db77ba4515 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:54.892155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:54.894489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:54.898460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:54.898851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:54.900355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:54.902639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] MFA Rules not processed for user `d83949fa7fee47e8989b775be05f610f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:54.902982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:54.904228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:54.951418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 994/1991] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:54.953514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:54.957808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.033051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:55.062782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 998/1992] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:55.066846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.068240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.082141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5e5f-d9db-428a-8396-8df1299713e7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.125635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c0acd-91cc-41b1-a465-cc273d804176 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.136690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.138629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.138911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.139185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.143450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:55.145874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.168001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.168652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.168931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.169202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] PATH_INFO: `/v3/users/9a2d9305b30c42d68f6a14c71db76ed5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.171621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2d9305b30c42d68f6a14c71db76ed5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.173744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.262932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2d9305b30c42d68f6a14c71db76ed5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:55.272687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.275229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.284399 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2d9305b30c42d68f6a14c71db76ed5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:55.292030 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 995/1993] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:55.302059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2d9305b30c42d68f6a14c71db76ed5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:55.302959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2d9305b30c42d68f6a14c71db76ed5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:55.305429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.314739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2d9305b30c42d68f6a14c71db76ed5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:55.324230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 999/1994] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:55 2022] DELETE /identity/v3/users/9a2d9305b30c42d68f6a14c71db76ed5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:55.325183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.325402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79b539-9ba6-468a-9e74-0479b36bc4fb service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.353073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.438558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.439841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.440656 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.441507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.444408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.517585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32093dd4-bf78-45a7-95d0-9aa1e14b77fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.527002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.528345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.529368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.529649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.530590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.533704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.543232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.545179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.558232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 996/1995] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:55.559743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.561816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.562969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1000/1996] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:55 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:55.568807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.578950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a5bd8-a53a-47e2-aa04-f2f78670262a service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.586324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.587264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.587709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.588729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.589794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.593244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.609119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2125-6eba-4202-8494-00d7e3a2abcc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.618100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.619218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.620206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.620409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.621436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.623506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:55.626900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.635264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 997/1997] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:55 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:55.639915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.677998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1001/1998] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:55.679986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.704002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da6ff-c3b6-4758-a0b5-f8ae2beb1634 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.808258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf56c-c501-4f36-96ad-ff10ffe11654 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.819968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.821740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.823268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.823569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.826045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.832493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.833536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:55.886458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 998/1999] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:55 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:55.887273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.890579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.892305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.892656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.892942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.894877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.899646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.912636 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0fe4-d962-4fef-8afd-8d5a15335ff4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.924572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1002/2000] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:55.925504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.926223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.926691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.928104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:55.928795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:55.930572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.933109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:55.935632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:55.965653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 999/2001] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:55.969130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263bd5-ee1e-4ec9-811e-738668523526 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:55.969589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:55.998709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:55.999376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:55.999663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:55.999943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] PATH_INFO: `/v3/projects/7b8a3f6dc9174e17a82f384b6646691e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.003170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8a3f6dc9174e17a82f384b6646691e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.004895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7905dc-6f39-4372-a55e-8e1b12d953bc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.007058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.012867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.014015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.014533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.015043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] PATH_INFO: `/v3/projects/d93c227a661f48a8a73591a586f769f5/users/a1d394fcb21343038cc7f2c9fea2bf00/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.048236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93c227a661f48a8a73591a586f769f5, user_id=a1d394fcb21343038cc7f2c9fea2bf00, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.051635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.071330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1000/2002] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:55 2022] PUT /identity/v3/projects/d93c227a661f48a8a73591a586f769f5/users/a1d394fcb21343038cc7f2c9fea2bf00/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.072188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.108804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8a3f6dc9174e17a82f384b6646691e', 'request_id': 'req-e45b89f7-7208-4504-8030-15545550ca0f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.120663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8a3f6dc9174e17a82f384b6646691e', 'request_id': 'req-e45b89f7-7208-4504-8030-15545550ca0f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.131167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8a3f6dc9174e17a82f384b6646691e', 'request_id': 'req-e45b89f7-7208-4504-8030-15545550ca0f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.163370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] The token cache is being invalidate because project 7b8a3f6dc9174e17a82f384b6646691e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:56.163552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.164724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e45b89f7-7208-4504-8030-15545550ca0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.167018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1003/2003] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:55 2022] DELETE /identity/v3/projects/7b8a3f6dc9174e17a82f384b6646691e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.168329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e9cca-c37c-4708-838c-7df0a541a444 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.168779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00de-cd74-4416-968e-462e307f9551 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.168779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00de-cd74-4416-968e-462e307f9551 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.169360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b00de-cd74-4416-968e-462e307f9551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.200220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-306b00de-cd74-4416-968e-462e307f9551 None None] MFA Rules not processed for user `a1d394fcb21343038cc7f2c9fea2bf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.201680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-306b00de-cd74-4416-968e-462e307f9551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.248162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.248713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.248999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.249254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] PATH_INFO: `/v3/projects/0b4b36db488949cda590e3a48c6751fa/users/f105777ffbbb455c84f78da807905681/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.253461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:56.267310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b36db488949cda590e3a48c6751fa, user_id=f105777ffbbb455c84f78da807905681, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.269966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de83f3-f4a7-4218-bbcb-84bd7ca29855 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.272500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1004/2004] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:56.274053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b00de-cd74-4416-968e-462e307f9551 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.275789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-306b00de-cd74-4416-968e-462e307f9551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.286508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1001/2005] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:56 2022] PUT /identity/v3/projects/0b4b36db488949cda590e3a48c6751fa/users/f105777ffbbb455c84f78da807905681/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.287969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.288509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.288956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.291121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b00de-cd74-4416-968e-462e307f9551 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.308563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.309765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.339119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:56.356958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.357927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.358253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.358821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] PATH_INFO: `/v3/projects/4631389703144e1e818700ddbe94a183` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.360222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4631389703144e1e818700ddbe94a183)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.362553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.377062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1002/2006] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:56.377719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.379130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.393073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac8a2-13d6-4257-889c-9d6e12b16e30 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.399446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.400082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.400355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.400634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] PATH_INFO: `/v3/projects/a9f34fff9d994df6ac3dc8d285f8159b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.401783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f34fff9d994df6ac3dc8d285f8159b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.403737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.430853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4631389703144e1e818700ddbe94a183', 'request_id': 'req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.443231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4631389703144e1e818700ddbe94a183', 'request_id': 'req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.452661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4631389703144e1e818700ddbe94a183', 'request_id': 'req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.458381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f34fff9d994df6ac3dc8d285f8159b', 'request_id': 'req-564eaa92-4f96-401e-aabe-a52654d0b988'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.467319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f34fff9d994df6ac3dc8d285f8159b', 'request_id': 'req-564eaa92-4f96-401e-aabe-a52654d0b988'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.468155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] The token cache is being invalidate because project 4631389703144e1e818700ddbe94a183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:56.468480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.469135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.473948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1005/2007] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:56 2022] DELETE /identity/v3/projects/4631389703144e1e818700ddbe94a183 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.473948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.473948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.488120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f34fff9d994df6ac3dc8d285f8159b', 'request_id': 'req-564eaa92-4f96-401e-aabe-a52654d0b988'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.503663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] The token cache is being invalidate because project a9f34fff9d994df6ac3dc8d285f8159b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:56.504124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.505138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.506951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1003/2008] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:56 2022] DELETE /identity/v3/projects/a9f34fff9d994df6ac3dc8d285f8159b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.510885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.511410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.543594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732eb9b-8b1e-49b1-ab20-b0477b245a3c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.594662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eaa92-4f96-401e-aabe-a52654d0b988 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.594943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.595629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.595910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.596182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.598288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.600085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.600716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.600994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.601306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.601966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.603642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247db01-6cd3-43b9-911c-db6047795120 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.614708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1004/2009] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:56.615984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ccbe-5a4d-4a67-9041-75ffe0c2c1f3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.616295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ccbe-5a4d-4a67-9041-75ffe0c2c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.616569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ccbe-5a4d-4a67-9041-75ffe0c2c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.626460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:56.639735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ae47ccbe-5a4d-4a67-9041-75ffe0c2c1f3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.641888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ae47ccbe-5a4d-4a67-9041-75ffe0c2c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.650745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1005/2010] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:56.655255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.655546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.655818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.658162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:56.670333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.672341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.677829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.679105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.687492 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1006/2011] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:56.688372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.689654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.693964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1006/2012] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:56.694931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.704663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77d3af-98dd-41b8-a343-485aeb2fe24c service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.705891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53755390-bbae-459f-b615-abaa92b7d19c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.710343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.711611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.711892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.712167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] PATH_INFO: `/v3/users/57009afed6e84243803b4360126c5b49` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.712296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.712896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.713183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.713331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57009afed6e84243803b4360126c5b49)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.713450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] PATH_INFO: `/v3/projects/0b4b36db488949cda590e3a48c6751fa/users/f105777ffbbb455c84f78da807905681/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.715266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.715398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b36db488949cda590e3a48c6751fa, user_id=f105777ffbbb455c84f78da807905681, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.718031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.729283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1007/2013] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:56 2022] PUT /identity/v3/projects/0b4b36db488949cda590e3a48c6751fa/users/f105777ffbbb455c84f78da807905681/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.731319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.764814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57009afed6e84243803b4360126c5b49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.772031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57009afed6e84243803b4360126c5b49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.784868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57009afed6e84243803b4360126c5b49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.785657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57009afed6e84243803b4360126c5b49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.794323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90b2003c-f0b3-40e7-b9db-b0cb17ab865b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57009afed6e84243803b4360126c5b49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:56.800378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1007/2014] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:56 2022] DELETE /identity/v3/users/57009afed6e84243803b4360126c5b49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:56.802197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6769-c63a-48c6-a2d0-12783b199cde None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.802197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6769-c63a-48c6-a2d0-12783b199cde None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.802197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6769-c63a-48c6-a2d0-12783b199cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.807062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712331f-e463-41ec-b6cb-3a4ee4bee05a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.824257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e70d6769-c63a-48c6-a2d0-12783b199cde None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.825214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e70d6769-c63a-48c6-a2d0-12783b199cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.886200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.886839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.887122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.887396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.888059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:56.888673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.893471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.921585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1008/2015] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:56.922645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:56.922806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1008/2016] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:56.924382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:56.925654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.926142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.926600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.946211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb35d3-629c-4659-a132-2f9934a6c5a9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:56.953644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:56.954537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:56.954825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:56.955287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] PATH_INFO: `/v3/users/a1d394fcb21343038cc7f2c9fea2bf00` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:56.957093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d394fcb21343038cc7f2c9fea2bf00)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:56.959313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:56.967760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] MFA Rules not processed for user `f105777ffbbb455c84f78da807905681`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:56.969988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.075053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d394fcb21343038cc7f2c9fea2bf00'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.078285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:57.101820 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d394fcb21343038cc7f2c9fea2bf00'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.124560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1009/2017] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:57.129936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.130020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d394fcb21343038cc7f2c9fea2bf00'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.130020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d394fcb21343038cc7f2c9fea2bf00'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.132603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.133815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:57.147668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d394fcb21343038cc7f2c9fea2bf00'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.160983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1009/2018] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:43:56 2022] DELETE /identity/v3/users/a1d394fcb21343038cc7f2c9fea2bf00 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:57.162440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.165618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.169629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df22221-0ec2-4c91-85cd-11c0cd30f0c1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.256156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79110a84-8f76-48a1-8049-879d14b2a913 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.262475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.263969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.264401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.264822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.266197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.266574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:57.266821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.267254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.267473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.267754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.268491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.269871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.271339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07fe5-92a9-4bde-b3d0-06183e866bc8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.289387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1010/2019] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:57.290827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.297219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.317233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1010/2020] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:57.319319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.319319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.319319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.364092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:57.365653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.462191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469362e3-4f5d-4e0e-8dc3-eadf81827805 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.499272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1011/2021] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:57.511999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.541556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ea41b-7df1-43db-b503-6007cc3889e4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.551222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.552380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.552676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.552951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.554602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.556244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.571886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.586040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.586349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.586627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.592632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.613647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1012/2022] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:57 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:57.614300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.617375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.687195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:57.698436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:57.707566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed510-23d9-4bb8-a2a8-e6504345a163 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.716238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.717935 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.718418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.719176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.719457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.719871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.720510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.722500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.734002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1011/2023] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:57.734846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.736394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.750516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1013/2024] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:57 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:57.751509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.753274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.756278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aa81-ef47-42e8-b764-8321f176fd28 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.765102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.766046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.766292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.767310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] PATH_INFO: `/v3/projects/2af4150c5d9747368bd8aadebf0213cf` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.772368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af4150c5d9747368bd8aadebf0213cf)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.776759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.817801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43861eef-eb95-4b36-9fa7-7052a5fc1877 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.822832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.823554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.823855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.824132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.841675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.843386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:57.856655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1014/2025] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:57.857560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.865164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af4150c5d9747368bd8aadebf0213cf', 'request_id': 'req-955afbf9-d1a2-481c-af74-3a4dd84e8992'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.867449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af468b-f954-49c0-87f7-13d789d35662 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:57.874233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af4150c5d9747368bd8aadebf0213cf', 'request_id': 'req-955afbf9-d1a2-481c-af74-3a4dd84e8992'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.884470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af4150c5d9747368bd8aadebf0213cf', 'request_id': 'req-955afbf9-d1a2-481c-af74-3a4dd84e8992'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.900413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] The token cache is being invalidate because project 2af4150c5d9747368bd8aadebf0213cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:57.900996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.901799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:57.903664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1012/2026] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:57 2022] DELETE /identity/v3/projects/2af4150c5d9747368bd8aadebf0213cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:57.904268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:57.905922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:57.958880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:57.959895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:57.960393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:57.961409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:57.962416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:57.972514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.010949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955afbf9-d1a2-481c-af74-3a4dd84e8992 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.018530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.019164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.019607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.020020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.023316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.023474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1015/2027] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:57 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:58.023474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.023658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb13b9-c4d0-4773-8c59-a88ee46e2604 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.025474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.039173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1013/2028] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:58.039173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.039173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.039489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.072421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.074546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.087450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1014/2029] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:58.088716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.090922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.110440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68f016-1e1c-40d3-8ad5-a9e9c77b05fd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.118255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649e355-61ce-4d77-a205-8192e41e7c90 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.119597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.120222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.120529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.120772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.121490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.123050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.123225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.123667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.123950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.124227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.126818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.136024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1015/2030] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:58.136900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.148531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c9829-e90b-4287-ad15-06aebc93ebbc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.155527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.156435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.156723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.157028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.157733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.159818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e93676-2de5-4340-8f11-633e3dc2c572 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.172337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1016/2031] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:58.173701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.173996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.174293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.180301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:58.197206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.198711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.209953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1017/2032] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:58.211013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.221060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891521-d6f1-4f30-9792-73b6548dcbd4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.225933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.226687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.227038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.227374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.228089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.229811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.230018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.233129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.241310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1018/2033] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:58.242876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.253101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1016/2034] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:58.254647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.266644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255c921-699f-420a-bcc1-ef41385dde96 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.275454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.276154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.276435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.276785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] PATH_INFO: `/v3/projects/f86703e33aa94d9dbb6faa89d776638a/users/d8be1f5eab814797a5e8b0b1e0a038b4/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.279096 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608ac1-febd-4bbc-8fea-d9858fe1893e service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.285287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.285990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.286498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.286861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.287697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:58.288075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.289973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.297925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86703e33aa94d9dbb6faa89d776638a, user_id=d8be1f5eab814797a5e8b0b1e0a038b4, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.300670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.303642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1017/2035] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:58.306512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.319321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:58.319558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfece693-f9b5-4aff-a536-faba334e7d86 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.327622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1019/2036] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:58 2022] PUT /identity/v3/projects/f86703e33aa94d9dbb6faa89d776638a/users/d8be1f5eab814797a5e8b0b1e0a038b4/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:58.328491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.331069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.403603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.404432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.404785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.405074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] PATH_INFO: `/v3/projects/7fb165de258e460fa78b5e20ec115b98/users/be1a8f9f43984a0b94a66313ecef80b1/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.423487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb165de258e460fa78b5e20ec115b98, user_id=be1a8f9f43984a0b94a66313ecef80b1, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.425238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afb3e2-d7fb-4007-89fd-6e99f40558e1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.426603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.431753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.432504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.432845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.433963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] PATH_INFO: `/v3/projects/d93c227a661f48a8a73591a586f769f5` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.435536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93c227a661f48a8a73591a586f769f5)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.437513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.446475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1018/2037] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:58 2022] PUT /identity/v3/projects/7fb165de258e460fa78b5e20ec115b98/users/be1a8f9f43984a0b94a66313ecef80b1/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:58.457133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.535529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93c227a661f48a8a73591a586f769f5', 'request_id': 'req-4f4323c2-a34e-4933-aa85-cec38df385cf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:58.545757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93c227a661f48a8a73591a586f769f5', 'request_id': 'req-4f4323c2-a34e-4933-aa85-cec38df385cf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:58.558904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea7b85-92d0-4edf-88f2-95e56882fae3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.559804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93c227a661f48a8a73591a586f769f5', 'request_id': 'req-4f4323c2-a34e-4933-aa85-cec38df385cf'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:58.594610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] The token cache is being invalidate because project d93c227a661f48a8a73591a586f769f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:43:58.597876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:58.598932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4f4323c2-a34e-4933-aa85-cec38df385cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:43:58.605316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1020/2038] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:43:58 2022] DELETE /identity/v3/projects/d93c227a661f48a8a73591a586f769f5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:58.605316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8262-d500-49f1-8edf-2dced0fed371 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.605316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8262-d500-49f1-8edf-2dced0fed371 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.605316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af8262-d500-49f1-8edf-2dced0fed371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.644040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:58.650481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f8af8262-d500-49f1-8edf-2dced0fed371 None None] MFA Rules not processed for user `d8be1f5eab814797a5e8b0b1e0a038b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.652100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f8af8262-d500-49f1-8edf-2dced0fed371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.671216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.674773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.675514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.675945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.676882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.680430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d5b72-1248-467e-825b-bc9e76417038 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.719350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1019/2039] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/projects => generated 409 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:58.728450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.728450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.728450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.753569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1021/2040] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:58.755152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.755498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.755831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.760251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] MFA Rules not processed for user `be1a8f9f43984a0b94a66313ecef80b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.761491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.781273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.782568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.796399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:58.854024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1020/2041] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:58.854266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1022/2042] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:58.861611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.861915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.861915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.865434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.877669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734850c-51a1-450e-b9d1-08688d8e8091 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.877898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d358d55-7d3c-4698-88df-9fe358681926 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:58.882858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.883026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:58.883756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.883990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.884087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.884286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.884396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.884557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.884928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.885208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:58.886897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.887196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcdca1-2dd5-4b85-a1ae-a0c0c4b78c52 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:58.912333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1023/2043] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/users => generated 305 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:58.914397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:58.914702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:58.914975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:58.924812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1021/2044] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:58.925570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:58.927234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.935264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:58.936482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:58.996578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dcdb5-c33b-4954-93c9-6e146cf2bf1b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.002216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1024/2045] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:59.002380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.002380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.002569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.002645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.002645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.014104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129e707-38a4-4fb7-b701-828c943c7664 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.019822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.020440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.020722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.020996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.021651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.023852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.035933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1025/2046] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:59.036570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.048107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56887297-c702-4be2-81ff-35c4f8b1be04 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.052932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.053529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.053806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.054096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.054759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.056721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.058837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.069298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.071429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.078913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1026/2047] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.079763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.081593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1022/2048] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:43:59.082438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.090485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b585e-771b-417e-9fc5-ae98ce033d93 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.093411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5375-4c50-4e3b-bd92-450270047d17 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.095573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.096404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.096518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.096831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.097716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:43:59.097825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.099475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.099785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.100540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.100792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.101900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.102558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.104300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.116936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1027/2049] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:43:59.116936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.118244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1023/2050] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:59.119803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.131890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac16ee0-e51e-43b9-8b4c-5bb588beeb17 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.136117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a266d-f2b2-4ddd-9f1b-126431e1ae76 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.137768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.138725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.139474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.140390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.140570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.142989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.146638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.147518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.149117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.149588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.150652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.154146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.167141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1028/2051] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:59.168132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.181552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5975f0-e697-47a0-9820-4fb9955de72e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.188130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.188819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.189100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.192439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] PATH_INFO: `/v3/projects/8ecef0656cf74175953e02a3c1a12d6d/users/7c64ef000b9e4d5b81f507812023cba6/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.192599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1024/2052] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.192599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.214414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecef0656cf74175953e02a3c1a12d6d, user_id=7c64ef000b9e4d5b81f507812023cba6, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.218263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.240814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1029/2053] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:59 2022] PUT /identity/v3/projects/8ecef0656cf74175953e02a3c1a12d6d/users/7c64ef000b9e4d5b81f507812023cba6/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:59.247048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.297541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.298988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1042-3352-4458-92fd-d63b7ef782a7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.347379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c72df4-23af-4fbb-a1b2-d261cdb1ce13 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.355655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.356349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.356735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.357170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.358735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.361851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e5bdc-a165-430f-b846-c541bc327009 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.381730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.382379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.382535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.382810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.383744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.385381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.394710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1030/2054] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.398118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1025/2055] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:59.398263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630911c-134f-43d0-8b97-089b322df9f0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.398263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630911c-134f-43d0-8b97-089b322df9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.398263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630911c-134f-43d0-8b97-089b322df9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.398820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.409955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437352d7-8346-493d-b7b0-0ed319047327 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.415455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.416004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.416288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.416610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.417214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.418885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.430460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1026/2056] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:43:59.431516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.432328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7630911c-134f-43d0-8b97-089b322df9f0 None None] MFA Rules not processed for user `7c64ef000b9e4d5b81f507812023cba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:59.433822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7630911c-134f-43d0-8b97-089b322df9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.443110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d14b2-7f30-4c2c-bfbc-446170f87d3e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.449646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.450450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.450787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.451461 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] PATH_INFO: `/v3/projects/ff5f8cb3aece42ed9dbf993accab7f51/users/34681f4ef8984687a3161095b8e4402b/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.474247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5f8cb3aece42ed9dbf993accab7f51, user_id=34681f4ef8984687a3161095b8e4402b, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.477796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.508698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1027/2057] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:59 2022] PUT /identity/v3/projects/ff5f8cb3aece42ed9dbf993accab7f51/users/34681f4ef8984687a3161095b8e4402b/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:59.515648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.530134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1031/2058] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:59.531583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.532017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.532435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.559162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.578553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] MFA Rules not processed for user `34681f4ef8984687a3161095b8e4402b`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:59.578553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.615491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4754fe8-5022-4e1b-8f0c-2b43279b8805 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.620627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.621325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.621703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.622041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.622788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.624455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.635123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1028/2059] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:43:59.636556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.648653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f83009-5e4e-49cb-93ab-c2424ec8019b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.651371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1032/2060] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:59.652258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.656727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.657493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.657966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.658370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.659207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.661596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.665698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7dc68-d24c-4de0-aa50-a1bb66b6ea76 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.672613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.673418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.673794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.674478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] PATH_INFO: `/v3/projects/a145462cde0147558fcc80efc48436b2/users/74bf86d85aad4033928f390b7576a653/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.699151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a145462cde0147558fcc80efc48436b2, user_id=74bf86d85aad4033928f390b7576a653, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.702486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.713674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1029/2061] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/projects => generated 407 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.714723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.724665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1033/2062] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:43:59 2022] PUT /identity/v3/projects/a145462cde0147558fcc80efc48436b2/users/74bf86d85aad4033928f390b7576a653/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:43:59.725589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.740964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:43:59.805831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c017e-fb87-4b19-998e-f9446dddbdd0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.813087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.813795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.814260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.814723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.815632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.817642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73d67-07dd-4145-b5e8-2c0a476956a9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.847281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1034/2063] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/users => generated 310 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.852477 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41227795-e5a1-4a26-9d1c-522c046bb81d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.854991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.855359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.855709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.863621 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.864656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.865264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.865543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.866735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.868736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.891981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] MFA Rules not processed for user `74bf86d85aad4033928f390b7576a653`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:43:59.893655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:43:59.908989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1030/2064] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:43:59.910538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.977595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1035/2065] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:43:59.978256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:43:59.988897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115c061-d465-4e20-be05-97ed6f063524 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.990648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f8c9-1ed4-4697-bf2d-3074b3edb946 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:43:59.994749 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.995546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.995822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.996094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.996747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:43:59.997245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:43:59.998158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:43:59.998491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:43:59.998813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:43:59.998967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:43:59.999851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.001635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.015428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1031/2066] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.016364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.027301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1036/2067] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:43:59 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:00.028129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774844b0-d0af-4594-af4a-db7d80f1082c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.028574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.034338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.034972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.035251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.035619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.036142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.039076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.042351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbacfd0-7811-4975-94da-e28d01aa9d38 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.048855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.050332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.051053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.052099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] PATH_INFO: `/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9/users/3d3c32f80d5d4d3d88f8a71bd073664b/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.064253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:00.077144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc3ba4adbdf43959fdd4c95eeed30d9, user_id=3d3c32f80d5d4d3d88f8a71bd073664b, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.078140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1032/2068] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:00.079227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.081763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.100921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1037/2069] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:00 2022] PUT /identity/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9/users/3d3c32f80d5d4d3d88f8a71bd073664b/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:00.102433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.172392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f59d-617a-480e-b1ce-5abaebe5dab2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.186662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:00.207757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6861-4dcd-4dc3-85a5-97cb72e0c4be admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.212755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.213430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.213773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.214006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.214814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.216852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.244755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1038/2070] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:00.245746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.260620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2aaea-ed9c-4675-9f66-7e7565fd1398 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.263037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.263823 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.264035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.264427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.265220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.265783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.266415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.266692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.266957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.267221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.267595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.269185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.282260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1033/2071] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.282450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1039/2072] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.282544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.283721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.291073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6ab1-5ff5-4a4a-a076-e320e62f3369 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.295516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cf942-bf3e-4b72-9f4e-69d9bc93ac77 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.295878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.296488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.296770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.297040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.298233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.299816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.300364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.301148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.301432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.301704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] PATH_INFO: `/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66/users/a71540fcd22c42bcb0ee3c8a85c26b6a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.311697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1034/2073] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.312512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.318578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39619d0d6f64cb4a7ada062c09f9d66, user_id=a71540fcd22c42bcb0ee3c8a85c26b6a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.321301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.323018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c58cb-ed8a-4014-b722-32cfcc4cbff2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.328003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.328701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.328930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.329210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] PATH_INFO: `/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9/users/3d3c32f80d5d4d3d88f8a71bd073664b/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.331154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc3ba4adbdf43959fdd4c95eeed30d9, user_id=3d3c32f80d5d4d3d88f8a71bd073664b, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.333758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.334570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1040/2074] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:00 2022] PUT /identity/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66/users/a71540fcd22c42bcb0ee3c8a85c26b6a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:00.338149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.346057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1035/2075] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:00 2022] PUT /identity/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9/users/3d3c32f80d5d4d3d88f8a71bd073664b/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:00.347019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.415154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce6e98-6525-4b93-b34c-00bd9c27cde2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.420919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.421956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.422267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.422540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.423193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.423573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e20dd-cc5a-46d2-9051-8d1ca073c96a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.425057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e82447-ce07-45ff-a836-a86a932181ad admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.429610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.431227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.431227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.431227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.431833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.433620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.437445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1036/2076] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.438625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423072-9fd8-4038-83f6-e963fa89f841 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.438908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423072-9fd8-4038-83f6-e963fa89f841 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.439185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b423072-9fd8-4038-83f6-e963fa89f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.449396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1041/2077] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:00.450660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.464881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52a1c-b7a5-46ce-826d-665192c4e9e5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.469929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.470755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.471035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.471434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] PATH_INFO: `/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66/users/a71540fcd22c42bcb0ee3c8a85c26b6a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.473559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39619d0d6f64cb4a7ada062c09f9d66, user_id=a71540fcd22c42bcb0ee3c8a85c26b6a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.476731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.482244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5b423072-9fd8-4038-83f6-e963fa89f841 None None] MFA Rules not processed for user `3d3c32f80d5d4d3d88f8a71bd073664b`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:00.484674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5b423072-9fd8-4038-83f6-e963fa89f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:00.488312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1042/2078] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:00 2022] PUT /identity/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66/users/a71540fcd22c42bcb0ee3c8a85c26b6a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:00.489209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.489966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:00.563842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684c1a1-62ba-4389-973d-150a3ed6c153 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.566735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1037/2079] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:00.568306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a826f4f-cf39-42b0-a64c-1af5ab4df60b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.568613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a826f4f-cf39-42b0-a64c-1af5ab4df60b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.568874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a826f4f-cf39-42b0-a64c-1af5ab4df60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.573335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.573547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.573790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.574083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] PATH_INFO: `/v3/projects/1e171c18f3a244aca22cee3b91106143/users/e0d94cd1b1974f87beff21965c640425/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.589701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e171c18f3a244aca22cee3b91106143, user_id=e0d94cd1b1974f87beff21965c640425, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.592633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.599940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7a826f4f-cf39-42b0-a64c-1af5ab4df60b None None] MFA Rules not processed for user `a71540fcd22c42bcb0ee3c8a85c26b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:00.602105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7a826f4f-cf39-42b0-a64c-1af5ab4df60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:00.614160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1043/2080] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:00 2022] PUT /identity/v3/projects/1e171c18f3a244aca22cee3b91106143/users/e0d94cd1b1974f87beff21965c640425/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:00.615479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.617997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:00.631786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:00.679783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1038/2081] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:00.682254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.682254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.682254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.701202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6b1a-e200-4715-b871-aa4d554748ad admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.701202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.701202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.701202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.701543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.723999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] MFA Rules not processed for user `e0d94cd1b1974f87beff21965c640425`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:00.725235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:00.760588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.762054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.771836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1044/2082] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:00.772760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.781639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4690-3c72-4f90-89ce-2833aae43d8a service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.785480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.786197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.786542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.786888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.795981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1039/2083] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:00.800070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.820031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:00.862748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.864182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.875530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1045/2084] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:00.889565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b0b2-f48e-433e-8c69-36cf5946037f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:00.894558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:00.895336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:00.895681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:00.896016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:00.896922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:00.899087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:00.950110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1040/2085] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:00.951555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:00.972675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524f148-68f0-4f36-9e56-d23102c68d22 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.070213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:01.080496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.081326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.082150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.082497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.083299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.086790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.137457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1046/2086] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:00 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:01.137749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.158724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334182-1ba1-4410-82b3-21a2d85be7c6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.187188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.187924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.188215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.193284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.206968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.206968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.229515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1041/2087] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:01.233785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.245678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1021798-f185-456f-b000-e41401a87c8c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.264842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.265529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.265869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.266193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] PATH_INFO: `/v3/projects/660dccfa5bf043b19d17ce77fa294023/users/db55ae91cda64ef8aea73d8584159e8b/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.292361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=660dccfa5bf043b19d17ce77fa294023, user_id=db55ae91cda64ef8aea73d8584159e8b, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.297087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.334305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1047/2088] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:01 2022] PUT /identity/v3/projects/660dccfa5bf043b19d17ce77fa294023/users/db55ae91cda64ef8aea73d8584159e8b/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:01.337313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.352360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28560a3-3168-4118-bc2d-236f6e238ebd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.434992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.435733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.436020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.436295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.441421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.454575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.481878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1042/2089] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:01.486350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.502387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.518867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254599-6691-451d-b155-9469644c11cb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.528783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.528783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.528783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.528783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] PATH_INFO: `/v3/projects/660dccfa5bf043b19d17ce77fa294023/users/db55ae91cda64ef8aea73d8584159e8b/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.529357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=660dccfa5bf043b19d17ce77fa294023, user_id=db55ae91cda64ef8aea73d8584159e8b, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.547736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70759fe4-534a-4df6-b127-2e409db2a46c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.573807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1048/2090] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:01 2022] PUT /identity/v3/projects/660dccfa5bf043b19d17ce77fa294023/users/db55ae91cda64ef8aea73d8584159e8b/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:01.586184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.586737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.587017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.618755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] MFA Rules not processed for user `db55ae91cda64ef8aea73d8584159e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:01.620246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:01.644816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc905a-7be7-461a-ac9a-2bb273ca3d51 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.708634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:01.725494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.726733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.727206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.727800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.764162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1049/2091] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:01.802441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:01.813286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3be7-0abe-4230-83e1-406547c244f2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:01.817182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:01.817789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:01.818093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:01.818956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:01.823522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.825222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.846278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1043/2092] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:01.896324 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:01.897821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:01.907882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1050/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:03.013805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:03.023884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad2ac-1c69-48ae-a8f5-0f770c5ba9dd service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:03.028696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:03.029397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:03.031537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:03.031904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:03.104649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:03.106284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:03.119260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1044/2094] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:03.912484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:03.922463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f5893-c8c9-4a2f-ba5e-04f30078d3a8 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:03.928278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:03.929733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:03.930134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:03.930502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:03.978697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:04.039029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:04.043674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:04.056084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1051/2095] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:04.917727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:04.927734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d23e1e-7b65-4567-9ba7-75c176c6c27c service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:04.932719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:04.933600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:04.934146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:04.934631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:05.011328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:05.012913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5d4fc-ea35-49d1-a13d-bad86207e5d7 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:05.022565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1045/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:05.073822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:05.075809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:05.180004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314c745-d38d-4346-a025-e3b89f1984ee service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:05.186013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:05.186764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:05.187252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:05.187704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] PATH_INFO: `/v3/users/d83949fa7fee47e8989b775be05f610f` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:05.207014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83949fa7fee47e8989b775be05f610f)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:05.209812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:05.301750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83949fa7fee47e8989b775be05f610f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:05.329393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83949fa7fee47e8989b775be05f610f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:05.344433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83949fa7fee47e8989b775be05f610f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:05.345355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83949fa7fee47e8989b775be05f610f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:05.369802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83949fa7fee47e8989b775be05f610f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:05.380409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1052/2097] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:05 2022] DELETE /identity/v3/users/d83949fa7fee47e8989b775be05f610f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:05.385564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:05.386053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:05.386530 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:05.430580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:05.431998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:05.489238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:05.544338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1046/2098] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:05.554196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:05.556183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:05.643885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:05.657043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c85e9-6dfc-46c9-9000-362c525d9cc3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:05.665684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:05.666272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:05.666272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:05.666575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:05.682534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:05.682534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:05.691493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1053/2099] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:05.948694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:05.950222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:06.025208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826e592-2bb5-4e8c-a055-017c067565d3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:06.029444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:06.030288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.030717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.031296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.035287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:06.154175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:06.158543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:06.159302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:06.161051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:06.172011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1047/2100] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:06.181206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55068d83-3c49-4622-8d34-beeea38c2890 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:06.186291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:06.197315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.197849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.198414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] PATH_INFO: `/v3/projects/d39431c15a2245b49f654dec31aa4e27` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.200051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39431c15a2245b49f654dec31aa4e27)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:06.202871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:06.308342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39431c15a2245b49f654dec31aa4e27', 'request_id': 'req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.315716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39431c15a2245b49f654dec31aa4e27', 'request_id': 'req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.341502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39431c15a2245b49f654dec31aa4e27', 'request_id': 'req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.365115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] The token cache is being invalidate because project d39431c15a2245b49f654dec31aa4e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:06.365932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.366719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.369405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1054/2101] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:06 2022] DELETE /identity/v3/projects/d39431c15a2245b49f654dec31aa4e27 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:06.373026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:06.388574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7c483-27af-4491-93c7-144943398780 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:06.552577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:06.553353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:06.553557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:06.553955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] PATH_INFO: `/v3/users/f105777ffbbb455c84f78da807905681` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:06.555463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f105777ffbbb455c84f78da807905681)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:06.558213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:06.617700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:06.663435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f105777ffbbb455c84f78da807905681'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.677722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f105777ffbbb455c84f78da807905681'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.697643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f105777ffbbb455c84f78da807905681'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.698725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f105777ffbbb455c84f78da807905681'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.707550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db74b94f-63c9-4a26-8c1b-fe5d221917e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f105777ffbbb455c84f78da807905681'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:06.719475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1048/2102] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:06 2022] DELETE /identity/v3/users/f105777ffbbb455c84f78da807905681 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:07.048207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.049947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:07.067266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e6ce-6d18-4f1e-8c3b-cade5ff8aefb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.151202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.152271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.152271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.152473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] PATH_INFO: `/v3/projects/0b4b36db488949cda590e3a48c6751fa` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.153642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4b36db488949cda590e3a48c6751fa)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.155544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.213986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4b36db488949cda590e3a48c6751fa', 'request_id': 'req-08025a4d-0caa-410f-ac8b-e159c339f054'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:07.221138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4b36db488949cda590e3a48c6751fa', 'request_id': 'req-08025a4d-0caa-410f-ac8b-e159c339f054'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:07.235015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4b36db488949cda590e3a48c6751fa', 'request_id': 'req-08025a4d-0caa-410f-ac8b-e159c339f054'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:07.253932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] The token cache is being invalidate because project 0b4b36db488949cda590e3a48c6751fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:07.254338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:07.255029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-08025a4d-0caa-410f-ac8b-e159c339f054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:07.257322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1055/2103] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:07 2022] DELETE /identity/v3/projects/0b4b36db488949cda590e3a48c6751fa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:07.262752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.263101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.263194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.284709 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:07.286045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:07.416715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1049/2104] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:07.426096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.426757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.427161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.435971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:07.450926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:07.452487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:07.471893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1056/2105] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:07.477215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.487659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9457b4-8597-4ba1-b6e7-14daf6e0d6fc None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.494935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.496194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.496641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.497056 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.497851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:07.498433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.500469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.520793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1050/2106] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:07.523833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.536898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117776-3e29-4069-b9c0-b4059bf5073c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.547726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.548446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.548797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.549137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.549870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.553076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.591113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1057/2107] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:07.592845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.603983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e583d8-7b91-4374-ba08-b1cd68b9c3bd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.716758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.718021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.718210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.718666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.719532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.721784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.752091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1051/2108] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:07.755715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.770960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc7cf-3622-4285-aa49-1b8853798f1a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.781780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.782541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.782910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.783284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.785549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.789904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.809957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1058/2109] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:44:07.813972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.836811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5e0a-fc3c-4900-b8f4-d539a586c38c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.843227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.843975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.844351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.844701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.845429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.848481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe80c87-bd5e-40a9-b79f-f02f79f9e63f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.866224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1052/2110] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:07.870726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:07.886642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c7fd3-7872-48b1-958c-a6a9ec01b7ed admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:07.901860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:07.902989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:07.903528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:07.903909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] PATH_INFO: `/v3/projects/cbefc6e3083d4adf9ad2007b4878a881/users/395ec9039552477f91169cd07c37c479/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:07.943369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbefc6e3083d4adf9ad2007b4878a881, user_id=395ec9039552477f91169cd07c37c479, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:07.946873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:07.988068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1059/2111] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:07 2022] PUT /identity/v3/projects/cbefc6e3083d4adf9ad2007b4878a881/users/395ec9039552477f91169cd07c37c479/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:07.999963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.000510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.000963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.031863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:08.043710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] MFA Rules not processed for user `395ec9039552477f91169cd07c37c479`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:08.045413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.145701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1053/2112] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:08.150208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.212692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01912503-9362-4111-a9de-f24cc627d0d4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.217207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.217805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.218091 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.218379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.219036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.220923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.247775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1060/2113] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:08 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:08.251879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.262590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceceaef-1bec-439c-995a-d90eb5bc73e8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.320294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.320937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.321156 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.321425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.322048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.323972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.345040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1054/2114] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:08 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:08.349291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.359976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead936de-c2c8-4174-a1af-58a608363a43 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.364633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.365238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.365510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.365776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.366993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.368687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.379093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1061/2115] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:08.383669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.394309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877065ab-90aa-4186-b307-c07e5eb4012e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.399330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.400024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.400343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.400616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] PATH_INFO: `/v3/projects/253b270bda814c43862395c1948de7ff/users/edd76c6ee0984638a9aba9cb86600471/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.415880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=253b270bda814c43862395c1948de7ff, user_id=edd76c6ee0984638a9aba9cb86600471, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.418843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.432931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1055/2116] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:08 2022] PUT /identity/v3/projects/253b270bda814c43862395c1948de7ff/users/edd76c6ee0984638a9aba9cb86600471/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:08.440439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.451019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d4abb-525e-4a04-979e-308903a01bbb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.485375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.487392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.512209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.512811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.513085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.513352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.514011 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.515785 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.526263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1062/2117] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:08.530194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.540524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa902b-a539-4588-837a-92c0f15b7476 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.545783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.546440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.546718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.546987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] PATH_INFO: `/v3/projects/253b270bda814c43862395c1948de7ff/users/edd76c6ee0984638a9aba9cb86600471/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.548917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253b270bda814c43862395c1948de7ff, user_id=edd76c6ee0984638a9aba9cb86600471, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.551623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7258d-079f-4617-8896-39db5ab26ca7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.553813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6411da1-3271-44f0-b2fe-a3ebccc6cd0b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.554828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:08.558619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.559229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.559516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.559785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] PATH_INFO: `/v3/users/d8be1f5eab814797a5e8b0b1e0a038b4` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.560941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8be1f5eab814797a5e8b0b1e0a038b4)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.562900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.564390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1063/2118] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:08 2022] PUT /identity/v3/projects/253b270bda814c43862395c1948de7ff/users/edd76c6ee0984638a9aba9cb86600471/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:08.570310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:08.575126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.575649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.576005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.608209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] MFA Rules not processed for user `edd76c6ee0984638a9aba9cb86600471`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:08.609541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.615439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8be1f5eab814797a5e8b0b1e0a038b4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:08.622849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8be1f5eab814797a5e8b0b1e0a038b4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:08.635999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8be1f5eab814797a5e8b0b1e0a038b4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:08.636705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8be1f5eab814797a5e8b0b1e0a038b4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:08.645306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b552953f-3d63-469a-ba11-40d8f86c6976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8be1f5eab814797a5e8b0b1e0a038b4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:08.651852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1056/2119] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:08 2022] DELETE /identity/v3/users/d8be1f5eab814797a5e8b0b1e0a038b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:08.656355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.656707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.657040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.678426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:08.679751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.692183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1064/2120] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:08.705615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.707420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.753604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1057/2121] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:08.760562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:08.761895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:08.766767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a343df-0df3-4338-92fd-99cd9746ed05 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.818274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.819311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.819617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.819870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1943f4-7168-4b67-9fa5-7cf93b8efe67 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:08.819984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.823780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:08.824394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:08.824803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:08.825090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:08.835745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.837183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.849645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1058/2122] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:08.889548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:08.921245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:08.923971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:08.940991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1065/2123] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:09.299878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:09.301863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:09.326357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb74d75-6658-4f10-ab10-d00bd605532c service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:09.354859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:09.355836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.356171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.356540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] PATH_INFO: `/v3/projects/f86703e33aa94d9dbb6faa89d776638a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.358169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86703e33aa94d9dbb6faa89d776638a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:09.360627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:09.409903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:09.451737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86703e33aa94d9dbb6faa89d776638a', 'request_id': 'req-d90c2b21-09f1-4cac-a374-f11e310b1690'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.459773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86703e33aa94d9dbb6faa89d776638a', 'request_id': 'req-d90c2b21-09f1-4cac-a374-f11e310b1690'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.473379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86703e33aa94d9dbb6faa89d776638a', 'request_id': 'req-d90c2b21-09f1-4cac-a374-f11e310b1690'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.473912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:09.475675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:09.486519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] The token cache is being invalidate because project f86703e33aa94d9dbb6faa89d776638a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:09.486806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.487521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.489594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1059/2124] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:09 2022] DELETE /identity/v3/projects/f86703e33aa94d9dbb6faa89d776638a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:09.494035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:09.497276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:09.503700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f7b4-9b8d-41b6-a400-3f8f758b2ba7 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:09.615092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2b21-09f1-4cac-a374-f11e310b1690 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:09.625062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:09.626022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.627400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.628036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] PATH_INFO: `/v3/users/34681f4ef8984687a3161095b8e4402b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.629943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34681f4ef8984687a3161095b8e4402b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:09.631988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:09.655151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:09.656698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.657103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.657380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] PATH_INFO: `/v3/users/7c64ef000b9e4d5b81f507812023cba6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.661705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c64ef000b9e4d5b81f507812023cba6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:09.667734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:09.696746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34681f4ef8984687a3161095b8e4402b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.708453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34681f4ef8984687a3161095b8e4402b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.727804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34681f4ef8984687a3161095b8e4402b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.729053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34681f4ef8984687a3161095b8e4402b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.745487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bc6a2f6-441a-44b4-80e4-33ffedacc3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34681f4ef8984687a3161095b8e4402b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.749002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c64ef000b9e4d5b81f507812023cba6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.755862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1060/2125] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:09 2022] DELETE /identity/v3/users/34681f4ef8984687a3161095b8e4402b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:09.781430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c64ef000b9e4d5b81f507812023cba6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.796459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c64ef000b9e4d5b81f507812023cba6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.798644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c64ef000b9e4d5b81f507812023cba6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.815965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c64ef000b9e4d5b81f507812023cba6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:09.823545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1066/2126] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:09 2022] DELETE /identity/v3/users/7c64ef000b9e4d5b81f507812023cba6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:09.828040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:09.828335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:09.828612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:09.862154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:09.863807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:09.913870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:10.010611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1061/2127] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:10.024693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.027067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.137715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12ab90-a72c-4322-827a-45361bd10cd0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.141565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.142521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.142521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.142813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.144826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.146589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.155350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.156818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.168281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebb1a2-a344-450a-b002-e9ab151dedbd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.174356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1067/2128] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:10.186015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.186702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.190289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.197247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] PATH_INFO: `/v3/projects/ff5f8cb3aece42ed9dbf993accab7f51` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.197379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.199341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.200575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5f8cb3aece42ed9dbf993accab7f51)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.206245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.217188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0eea-744b-47b5-9da4-759baf3c1b90 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.224539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.226229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.226853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.227274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] PATH_INFO: `/v3/users/395ec9039552477f91169cd07c37c479` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.229115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=395ec9039552477f91169cd07c37c479)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.231509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.235915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:10.277786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5f8cb3aece42ed9dbf993accab7f51', 'request_id': 'req-7b075c05-b534-4a7e-9349-be04135dec85'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.285902 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5f8cb3aece42ed9dbf993accab7f51', 'request_id': 'req-7b075c05-b534-4a7e-9349-be04135dec85'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.295628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5f8cb3aece42ed9dbf993accab7f51', 'request_id': 'req-7b075c05-b534-4a7e-9349-be04135dec85'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.306294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395ec9039552477f91169cd07c37c479'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.308432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] The token cache is being invalidate because project ff5f8cb3aece42ed9dbf993accab7f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:10.308730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.309397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.314254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1062/2129] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:10 2022] DELETE /identity/v3/projects/ff5f8cb3aece42ed9dbf993accab7f51 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:10.315107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.317022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.321937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395ec9039552477f91169cd07c37c479'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.332616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395ec9039552477f91169cd07c37c479'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.333434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395ec9039552477f91169cd07c37c479'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.345860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2c1779d1-1d4e-4cdf-9307-b2daf4a8e0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395ec9039552477f91169cd07c37c479'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.356487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1068/2130] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:10 2022] DELETE /identity/v3/users/395ec9039552477f91169cd07c37c479 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:10.360844 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.361135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.361383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.393423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:10.394673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.403114 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075c05-b534-4a7e-9349-be04135dec85 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.462056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1069/2131] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:10.472456 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.473921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.474752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.475570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.475802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.476038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] PATH_INFO: `/v3/users/a71540fcd22c42bcb0ee3c8a85c26b6a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.477626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71540fcd22c42bcb0ee3c8a85c26b6a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.481398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.483213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:10.539487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e81f18-37fa-48fb-802b-7e71c048a0bf None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.545081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.545774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.546139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.546475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.546617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71540fcd22c42bcb0ee3c8a85c26b6a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.559425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.560894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:10.566937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71540fcd22c42bcb0ee3c8a85c26b6a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.586705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71540fcd22c42bcb0ee3c8a85c26b6a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.587703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1070/2132] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:10.596026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71540fcd22c42bcb0ee3c8a85c26b6a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.615518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bfa8d82b-a9c5-4cd0-809b-5b7c100210b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71540fcd22c42bcb0ee3c8a85c26b6a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:10.626142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1063/2133] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:10 2022] DELETE /identity/v3/users/a71540fcd22c42bcb0ee3c8a85c26b6a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:10.858413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:10.860635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:10.889843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29425d03-18f5-4c54-b1da-faeade6abd76 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:10.926642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:10.977621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:10.978902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:10.979362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:10.979815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] PATH_INFO: `/v3/users/74bf86d85aad4033928f390b7576a653` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:10.981158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74bf86d85aad4033928f390b7576a653)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:10.983593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.073915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74bf86d85aad4033928f390b7576a653'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.103405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74bf86d85aad4033928f390b7576a653'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.113423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74bf86d85aad4033928f390b7576a653'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.114441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74bf86d85aad4033928f390b7576a653'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.129998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74bf86d85aad4033928f390b7576a653'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.137700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1071/2134] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:10 2022] DELETE /identity/v3/users/74bf86d85aad4033928f390b7576a653 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:11.142521 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.142806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.143081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.165291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.167245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:11.168685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.169241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.277386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1064/2135] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:11.278376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.291162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.317762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d2c6d-3f7e-4cf7-bf3a-14aeac71b838 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.334782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.335551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.335837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.336118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] PATH_INFO: `/v3/projects/cbefc6e3083d4adf9ad2007b4878a881` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.338825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbefc6e3083d4adf9ad2007b4878a881)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.342194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.347146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1b625-6dda-47e6-ab04-713603816ac6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.363177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.364086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.365000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.365453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] PATH_INFO: `/v3/projects/8ecef0656cf74175953e02a3c1a12d6d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.367800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecef0656cf74175953e02a3c1a12d6d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.370552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.416644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbefc6e3083d4adf9ad2007b4878a881', 'request_id': 'req-087e0645-a3a5-4c19-b8ab-6c45114e0f73'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.423543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbefc6e3083d4adf9ad2007b4878a881', 'request_id': 'req-087e0645-a3a5-4c19-b8ab-6c45114e0f73'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.438294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbefc6e3083d4adf9ad2007b4878a881', 'request_id': 'req-087e0645-a3a5-4c19-b8ab-6c45114e0f73'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.443283 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:11.450482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecef0656cf74175953e02a3c1a12d6d', 'request_id': 'req-1e9e605f-184b-4564-b04b-c7b0b6078ee1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.461052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecef0656cf74175953e02a3c1a12d6d', 'request_id': 'req-1e9e605f-184b-4564-b04b-c7b0b6078ee1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.466536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] The token cache is being invalidate because project cbefc6e3083d4adf9ad2007b4878a881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:11.466957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.468322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.473694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1065/2136] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/projects/cbefc6e3083d4adf9ad2007b4878a881 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:11.473694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.473694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.479775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecef0656cf74175953e02a3c1a12d6d', 'request_id': 'req-1e9e605f-184b-4564-b04b-c7b0b6078ee1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.481143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:11.493421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] The token cache is being invalidate because project 8ecef0656cf74175953e02a3c1a12d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:11.493770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.494551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.496294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1072/2137] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/projects/8ecef0656cf74175953e02a3c1a12d6d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:11.497309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.498791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.565459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e605f-184b-4564-b04b-c7b0b6078ee1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.569644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0645-a3a5-4c19-b8ab-6c45114e0f73 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.570511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.571123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.571387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.571659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.574471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.634750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.635580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.635925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.636267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] PATH_INFO: `/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.637434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39619d0d6f64cb4a7ada062c09f9d66)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.639343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.650086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.652270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.663678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1073/2138] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:11.664476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.666898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.683869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937b7bb-f44a-4fe6-9b6d-4cf5d1f30770 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.704441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39619d0d6f64cb4a7ada062c09f9d66', 'request_id': 'req-194b6305-3935-4941-91bb-e5d587fa11dd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.716060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39619d0d6f64cb4a7ada062c09f9d66', 'request_id': 'req-194b6305-3935-4941-91bb-e5d587fa11dd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.746464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39619d0d6f64cb4a7ada062c09f9d66', 'request_id': 'req-194b6305-3935-4941-91bb-e5d587fa11dd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.762933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] The token cache is being invalidate because project c39619d0d6f64cb4a7ada062c09f9d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:11.763274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.763973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.766808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1066/2139] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/projects/c39619d0d6f64cb4a7ada062c09f9d66 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:11.767601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.767715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.768621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.769031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.769174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.769479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] PATH_INFO: `/v3/users/edd76c6ee0984638a9aba9cb86600471` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.771561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd76c6ee0984638a9aba9cb86600471)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.773827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.787393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b6305-3935-4941-91bb-e5d587fa11dd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:11.796867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:11.797658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.800774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.801163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] PATH_INFO: `/v3/users/3d3c32f80d5d4d3d88f8a71bd073664b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:11.803057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3c32f80d5d4d3d88f8a71bd073664b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:11.806700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:11.811153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:11.846168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd76c6ee0984638a9aba9cb86600471'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.862002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd76c6ee0984638a9aba9cb86600471'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.869487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:11.873073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd76c6ee0984638a9aba9cb86600471'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.874157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd76c6ee0984638a9aba9cb86600471'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.886717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3c32f80d5d4d3d88f8a71bd073664b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.888842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd76c6ee0984638a9aba9cb86600471'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.901054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1074/2140] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/users/edd76c6ee0984638a9aba9cb86600471 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:11.902180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3c32f80d5d4d3d88f8a71bd073664b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.903357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:11.918497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3c32f80d5d4d3d88f8a71bd073664b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.919472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3c32f80d5d4d3d88f8a71bd073664b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.921409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:11.931646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-783aeae5-a10c-4b96-b84a-5868a3b31fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3c32f80d5d4d3d88f8a71bd073664b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:11.945292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1067/2141] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/users/3d3c32f80d5d4d3d88f8a71bd073664b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:11.949293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1808e8-bb4f-4ed3-8ef2-74715599da2d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:11.949722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1808e8-bb4f-4ed3-8ef2-74715599da2d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:11.950538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1808e8-bb4f-4ed3-8ef2-74715599da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.001866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0c1808e8-bb4f-4ed3-8ef2-74715599da2d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:12.003254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0c1808e8-bb4f-4ed3-8ef2-74715599da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.070980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163dfb1-8f0a-4122-ad04-c357b3b30890 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.094916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1068/2142] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:12.102978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.103550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.104279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.138615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:12.144507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.160421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1069/2143] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:12.164499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.197579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f6ed7-bc98-403c-aee1-9e18c69e77e0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.207676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.212111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.212320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.212551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.213147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] PATH_INFO: `/v3/users/be1a8f9f43984a0b94a66313ecef80b1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.213308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.213732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.214233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.215108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:12.215486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.215767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1a8f9f43984a0b94a66313ecef80b1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.219419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.221599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.271780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1070/2144] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:12.275329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.300970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079713-1f6d-4e1c-8889-1a57bbaa234b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.317601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.318367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.320642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.320913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.321760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.327502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.328882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1a8f9f43984a0b94a66313ecef80b1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.340439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:12.363777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1a8f9f43984a0b94a66313ecef80b1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.382831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1a8f9f43984a0b94a66313ecef80b1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.383732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1a8f9f43984a0b94a66313ecef80b1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.397139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1071/2145] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:12.401393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.403882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-40f298a3-5cb1-4ebf-a56b-5c8bb94e0954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1a8f9f43984a0b94a66313ecef80b1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.404041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.411224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1075/2146] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:11 2022] DELETE /identity/v3/users/be1a8f9f43984a0b94a66313ecef80b1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:12.416340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.416632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.416914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.487226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:12.498325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3cb9-009c-4104-9e9c-e0ab3d2fbfc9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.499024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.516956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:12.603957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.604660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.605038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.605382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.606454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.608667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.642632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1072/2147] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:12.644344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.680829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023168a-afda-4b78-b8e4-5c397adb89be admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.692210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.693715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.695054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.695727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.696628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.700332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1076/2148] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:12.708585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.726408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.728140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.732836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1073/2149] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:12.732836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.734448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.782946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32056ec-fadc-447e-8009-5e88b4532522 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.788585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.789238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.789525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.789803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] PATH_INFO: `/v3/projects/253b270bda814c43862395c1948de7ff` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.791204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253b270bda814c43862395c1948de7ff)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.793119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.849853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cba19-aaa2-4fc2-8419-fce87474c7cd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.855500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.856134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.856480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.856644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.868704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.870730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.882364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1077/2150] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:12.883631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.885391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253b270bda814c43862395c1948de7ff', 'request_id': 'req-23b198c3-f9b2-489c-a8d9-04a8ebf34434'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.893168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253b270bda814c43862395c1948de7ff', 'request_id': 'req-23b198c3-f9b2-489c-a8d9-04a8ebf34434'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.893343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332dd9-3fa1-4f0f-a6f4-b88bb216abb2 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:12.906884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253b270bda814c43862395c1948de7ff', 'request_id': 'req-23b198c3-f9b2-489c-a8d9-04a8ebf34434'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.919906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] The token cache is being invalidate because project 253b270bda814c43862395c1948de7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:12.920338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.921037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:12.926116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1074/2151] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:12 2022] DELETE /identity/v3/projects/253b270bda814c43862395c1948de7ff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:12.927048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:12.928488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:12.965159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:12.965807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.966133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.966410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:12.967059 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:12.968676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1938d-99f5-415c-90b0-09b923ebfab3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:12.982202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1078/2152] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:12.990615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:12.991977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:12.992421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.023928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b198c3-f9b2-489c-a8d9-04a8ebf34434 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.025253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.026839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.031124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.032071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.033007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.033348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] PATH_INFO: `/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.034850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc3ba4adbdf43959fdd4c95eeed30d9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.037111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.040609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1079/2153] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:13.042236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.043967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.052661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.071583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd6264-de22-4d50-8da5-95e5c2044cb5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.077344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.078404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.078687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.079681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] PATH_INFO: `/v3/projects/131c8cf3f49b4a9e9ac7c7df21cc4f36/users/c9e7787d1559495895b93c06ab84dfac/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.096837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.109234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=131c8cf3f49b4a9e9ac7c7df21cc4f36, user_id=c9e7787d1559495895b93c06ab84dfac, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.113194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a574c-37af-4e65-96e1-bdcbeaae7825 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.134334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1080/2154] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:13 2022] PUT /identity/v3/projects/131c8cf3f49b4a9e9ac7c7df21cc4f36/users/c9e7787d1559495895b93c06ab84dfac/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:13.135479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aa9b-321a-4cc4-affc-b5b9ab4c585a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.135886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aa9b-321a-4cc4-affc-b5b9ab4c585a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.136262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320aa9b-321a-4cc4-affc-b5b9ab4c585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.150598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc3ba4adbdf43959fdd4c95eeed30d9', 'request_id': 'req-55a09f55-730d-49ba-b46f-97638f8364b7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.163020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c320aa9b-321a-4cc4-affc-b5b9ab4c585a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.163213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc3ba4adbdf43959fdd4c95eeed30d9', 'request_id': 'req-55a09f55-730d-49ba-b46f-97638f8364b7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.164291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c320aa9b-321a-4cc4-affc-b5b9ab4c585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.178320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc3ba4adbdf43959fdd4c95eeed30d9', 'request_id': 'req-55a09f55-730d-49ba-b46f-97638f8364b7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.193628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] The token cache is being invalidate because project 9cc3ba4adbdf43959fdd4c95eeed30d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:13.195407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.196276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.198815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1075/2155] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:12 2022] DELETE /identity/v3/projects/9cc3ba4adbdf43959fdd4c95eeed30d9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:13.199948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.201580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.242227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1081/2156] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:13.245908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0e80-dd8e-4c2c-9447-7b26232d5dce None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.245908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0e80-dd8e-4c2c-9447-7b26232d5dce None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.245908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b0e80-dd8e-4c2c-9447-7b26232d5dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.276814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f71b0e80-dd8e-4c2c-9447-7b26232d5dce None None] MFA Rules not processed for user `c9e7787d1559495895b93c06ab84dfac`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.278377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f71b0e80-dd8e-4c2c-9447-7b26232d5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.291228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09f55-730d-49ba-b46f-97638f8364b7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.301918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.304299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.304887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.305476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] PATH_INFO: `/v3/projects/a145462cde0147558fcc80efc48436b2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.307520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a145462cde0147558fcc80efc48436b2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.310915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.363191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1082/2157] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:13.369071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.369362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.370122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.395691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.397133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.409288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a145462cde0147558fcc80efc48436b2', 'request_id': 'req-f2298037-aa0d-480b-98f2-49868c235d50'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.417815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a145462cde0147558fcc80efc48436b2', 'request_id': 'req-f2298037-aa0d-480b-98f2-49868c235d50'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.429167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a145462cde0147558fcc80efc48436b2', 'request_id': 'req-f2298037-aa0d-480b-98f2-49868c235d50'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.442859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] The token cache is being invalidate because project a145462cde0147558fcc80efc48436b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:13.443173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.443842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.446152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1076/2158] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:13 2022] DELETE /identity/v3/projects/a145462cde0147558fcc80efc48436b2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:13.446987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.448345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.478622 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1083/2159] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:13.483913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.486918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.499488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.516998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:13.545552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298037-aa0d-480b-98f2-49868c235d50 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.550616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.551226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.551503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.551772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.552214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999cd32-e848-4590-b62c-88bc40014589 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.552426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:13.552727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.555103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.556957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.557632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.557978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.558393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.560546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.570879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1077/2160] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:13.572091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.574177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.590186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b9bd4-117a-4295-bdea-17730ce03156 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.594947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.595742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.596084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.596423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] PATH_INFO: `/v3/users/e0d94cd1b1974f87beff21965c640425` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.597638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d94cd1b1974f87beff21965c640425)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.599778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.645917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.647488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5da2ef-9d67-40eb-8bd6-e05cb836b5ed service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.657574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d94cd1b1974f87beff21965c640425'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.659015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1084/2161] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:13.660554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.660847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.661164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.666958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d94cd1b1974f87beff21965c640425'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.687572 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:13.689291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.690484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d94cd1b1974f87beff21965c640425'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.691504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d94cd1b1974f87beff21965c640425'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.704171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1085/2162] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:13.705101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d94cd1b1974f87beff21965c640425'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:13.708888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.714703 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1078/2163] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:13 2022] DELETE /identity/v3/users/e0d94cd1b1974f87beff21965c640425 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:13.730350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa91c6e-4edd-4e4d-ae8c-1ed592563120 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.739428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.743356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.861454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.862210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.864319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.867018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.867950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.876449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.917735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d50dd0-e190-4ca3-bed9-4f65b3a0e192 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:13.925778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:13.928267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1086/2164] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:13.930052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.931921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.937890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:13.938779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:13.938779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:13.939386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:13.939702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:13.941422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:13.964380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1079/2165] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:13.964674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:13.977412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:13.995700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972a296-5f8a-4389-9514-25592775c839 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.020958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:14.044167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671049-8802-4365-96b8-229d2445eca9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.049455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:14.049742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.050516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.050845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.051176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] PATH_INFO: `/v3/projects/7fb165de258e460fa78b5e20ec115b98` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.052590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb165de258e460fa78b5e20ec115b98)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.055344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.080032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.081543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.082027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.082537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.083999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.087695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.122161 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1080/2166] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:13 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:14.123435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.146050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0994ec-23c8-42b0-a89a-c85de0c7c2d2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.146367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb165de258e460fa78b5e20ec115b98', 'request_id': 'req-63e371e0-ab9f-4945-ae86-b1ea7afee079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.161987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb165de258e460fa78b5e20ec115b98', 'request_id': 'req-63e371e0-ab9f-4945-ae86-b1ea7afee079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.182382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb165de258e460fa78b5e20ec115b98', 'request_id': 'req-63e371e0-ab9f-4945-ae86-b1ea7afee079'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.203812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] The token cache is being invalidate because project 7fb165de258e460fa78b5e20ec115b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:14.204117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.205739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.208241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1087/2167] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:13 2022] DELETE /identity/v3/projects/7fb165de258e460fa78b5e20ec115b98 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:14.209108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.211254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.236404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.237059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.237436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.238386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.239493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.241671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eaa2e-50ee-44ec-8ad3-0d0814bcde3c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.306449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1081/2168] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:14.306672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.307394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.307394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.346948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:14.349440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.391997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e371e0-ab9f-4945-ae86-b1ea7afee079 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.502153 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1082/2169] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:14.503040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.504396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.517514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.518619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.518980 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.519329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.520325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.523178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3065c-cc80-4592-aba3-0084a66f0d18 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.541762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1088/2170] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:14.543262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd22884-9c4a-4b5d-9242-23f9437a886c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.543757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.543757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.544111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.550327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.551064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.551419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.551787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.552533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.554750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.580772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1083/2171] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/users => generated 292 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:14.581728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.584364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.593955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:14.595240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.601384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03b4e-e234-4dfb-a46f-5260664d3282 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.605566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1089/2172] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:14.606499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.609425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.614243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.614243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.614243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] PATH_INFO: `/v3/projects/1e171c18f3a244aca22cee3b91106143` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.615419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e171c18f3a244aca22cee3b91106143)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.616951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b01a-c1a0-480d-865e-4b93cf3f959a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.617981 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.631250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.631919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.632196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.632478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.633378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.635028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.637461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:14.649801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1090/2173] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:14.651535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.663939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ac231-d453-4e34-9321-4c08ea94ac39 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.671204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.672464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.672752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.673028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.673875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:14.675113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.677396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.692079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1091/2174] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:14.692998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.693721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e171c18f3a244aca22cee3b91106143', 'request_id': 'req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.703535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e171c18f3a244aca22cee3b91106143', 'request_id': 'req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.704645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535ae7d-9978-4718-9b19-ea1ebd27db76 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.716356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e171c18f3a244aca22cee3b91106143', 'request_id': 'req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.734141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] The token cache is being invalidate because project 1e171c18f3a244aca22cee3b91106143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:14.734141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.734993 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:14.736940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1084/2175] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:14 2022] DELETE /identity/v3/projects/1e171c18f3a244aca22cee3b91106143 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:14.739030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.740831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.789720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.790558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.790842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.791114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.792189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:14.792512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.795497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.818282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1092/2176] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:14.818282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.824520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.831950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b3f3-c9fa-4c75-9fe2-d7144f58dbf3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.837861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.838711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.839544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.839544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] PATH_INFO: `/v3/projects/2244e8c17b0240ac8404cfbdcb9987e1/users/3e981040f515413f95d7114dab9a243f/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.857230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2244e8c17b0240ac8404cfbdcb9987e1, user_id=3e981040f515413f95d7114dab9a243f, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.860137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.860281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5962d0-e2d9-490d-8d12-bd13c8abd416 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.867920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:14.868591 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:14.869078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:14.869360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:14.870020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:14.872513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:14.878239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1085/2177] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:14 2022] PUT /identity/v3/projects/2244e8c17b0240ac8404cfbdcb9987e1/users/3e981040f515413f95d7114dab9a243f/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:14.884629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.888720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.895326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1093/2178] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:14.896635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:14.899766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:14.919672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca67ab-ff8d-4f58-a23e-410c1d79d571 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:14.998204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a66ce-99b1-44cc-86c3-23c1646e7368 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.003418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.004069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.004692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.004978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] PATH_INFO: `/v3/users/db55ae91cda64ef8aea73d8584159e8b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.006261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db55ae91cda64ef8aea73d8584159e8b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.007602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.009013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.009774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.014380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.017759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.018781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.021243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a71e-4b9f-409e-95fe-09552a9fcace admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.057914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1094/2179] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:14 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:15.057914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.057914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.057914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.075146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:15.077412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db55ae91cda64ef8aea73d8584159e8b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.080830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:15.082420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.089671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db55ae91cda64ef8aea73d8584159e8b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.109517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db55ae91cda64ef8aea73d8584159e8b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.111257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db55ae91cda64ef8aea73d8584159e8b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.121973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db55ae91cda64ef8aea73d8584159e8b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.138255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1086/2180] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:14 2022] DELETE /identity/v3/users/db55ae91cda64ef8aea73d8584159e8b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:15.138255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.140366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.152940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:15.170215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1095/2181] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:15.171912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.173495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.186211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecba629-1b8a-4790-944d-3783c5ab7273 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.247061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220cf2b-b2d3-4f66-b517-71c4e26b8859 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.263760 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.265880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.266597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.266711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.266927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.267084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.267322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.267421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] PATH_INFO: `/v3/projects/562cda60de104cfeb2f33b5e7161ca43/users/8243650e772b4b619216ada663df9fce/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.268246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.270840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.304367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=562cda60de104cfeb2f33b5e7161ca43, user_id=8243650e772b4b619216ada663df9fce, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.304367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.307954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1096/2182] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:15 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:15.308848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.313632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.321542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1087/2183] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:15 2022] PUT /identity/v3/projects/562cda60de104cfeb2f33b5e7161ca43/users/8243650e772b4b619216ada663df9fce/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:15.323942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.479623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef4976-194c-41f1-b204-d4fd19bb7a6f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.506375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.506657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.507377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.507661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.511380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.513094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5442c-c20c-42f2-a058-6dd98fcbf08a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.520537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1d8f-f5fa-489c-ac7e-4f846339c11a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.544481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1088/2184] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:15.556316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.556496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.556763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.635222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] MFA Rules not processed for user `8243650e772b4b619216ada663df9fce`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:15.636826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.645040 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.646188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.646542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.646890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.662642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.665818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36c25d-c157-4286-878a-ea0592bba741 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.681394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:15.683546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1097/2185] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:15.685154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.685537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.685901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.693488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1098/2186] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:44:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:44:15.694695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.697704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.727228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01309-4690-46be-960c-7e181ea51345 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.735736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.739742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.739742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.739742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] PATH_INFO: `/v3/users/3fa949de246545a483c8e81207bf81d8` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.739742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa949de246545a483c8e81207bf81d8)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.740857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1089/2187] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:15.742211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.742754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.757243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f450c3-e210-47f5-87f8-4ef118b51315 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.763411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.764483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.764925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.765654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.766838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.768842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.789528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1090/2188] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:15.790894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.793063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.809044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eab698-efa5-4834-b9d9-4f78c395bf95 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:15.817704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:15.818405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.818692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.818971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] PATH_INFO: `/v3/projects/660dccfa5bf043b19d17ce77fa294023` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.820295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:15.821224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660dccfa5bf043b19d17ce77fa294023)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:15.824418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:15.832106 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa949de246545a483c8e81207bf81d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.855545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa949de246545a483c8e81207bf81d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.865100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa949de246545a483c8e81207bf81d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.866860 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa949de246545a483c8e81207bf81d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.877231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7c229f4e-48d0-4a75-a7d8-59090c37ff0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa949de246545a483c8e81207bf81d8'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.886216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1099/2189] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:15 2022] DELETE /identity/v3/users/3fa949de246545a483c8e81207bf81d8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:15.887734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:15.888020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:15.888295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:15.911368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660dccfa5bf043b19d17ce77fa294023', 'request_id': 'req-16a5da01-e677-4eee-b349-31c257614a00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.924238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660dccfa5bf043b19d17ce77fa294023', 'request_id': 'req-16a5da01-e677-4eee-b349-31c257614a00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.941799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660dccfa5bf043b19d17ce77fa294023', 'request_id': 'req-16a5da01-e677-4eee-b349-31c257614a00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.963151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:15.968552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:15.981138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] The token cache is being invalidate because project 660dccfa5bf043b19d17ce77fa294023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:15.981678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.982609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:15.985223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1091/2190] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:15 2022] DELETE /identity/v3/projects/660dccfa5bf043b19d17ce77fa294023 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:15.986611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:15.990641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.098664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1100/2191] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.099680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.101863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.122159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa037a6-5f92-4292-951f-187d88912e99 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.122612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5da01-e677-4eee-b349-31c257614a00 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.129738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.130865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.131038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.131270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] PATH_INFO: `/v3/projects/52a85cd06a53421f82e54b2319ad91af/users/6d498f9f15a84f4489c2c3f2eab74781/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.135466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.139522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.139821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.140087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.140743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.146935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.159219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a85cd06a53421f82e54b2319ad91af, user_id=6d498f9f15a84f4489c2c3f2eab74781, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.162649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c49b44-77f1-4256-a0e1-ef9ab181cc60 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.190166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1101/2192] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:16 2022] PUT /identity/v3/projects/52a85cd06a53421f82e54b2319ad91af/users/6d498f9f15a84f4489c2c3f2eab74781/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:16.191510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.191793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.192062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.216411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1092/2193] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:15 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:16.220536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.221446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.222197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.226176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.271440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:16.317195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1102/2194] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.317195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.317195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.329105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de6af6-9555-49d5-a153-30cf5e6dd96d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.335558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.336219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.336507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.336765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] PATH_INFO: `/v3/projects/53e787dbbd234a98950197aea08d22a0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.337920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e787dbbd234a98950197aea08d22a0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.339971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.360063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484845-f3cd-4682-9d39-025380854b2c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.369023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.370235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.370527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.370803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.371546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:16.386678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.388526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b578-227d-4718-898c-5857724e6917 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.407418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1093/2195] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:16.408554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047f07-a680-4847-8e07-49e40bf2b8a3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.408851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047f07-a680-4847-8e07-49e40bf2b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.409204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f047f07-a680-4847-8e07-49e40bf2b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.426329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e787dbbd234a98950197aea08d22a0', 'request_id': 'req-a0a9987d-0ae2-4311-812a-a0a2c971eb36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:16.434481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e787dbbd234a98950197aea08d22a0', 'request_id': 'req-a0a9987d-0ae2-4311-812a-a0a2c971eb36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:16.439498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8f047f07-a680-4847-8e07-49e40bf2b8a3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.441209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f047f07-a680-4847-8e07-49e40bf2b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.446445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e787dbbd234a98950197aea08d22a0', 'request_id': 'req-a0a9987d-0ae2-4311-812a-a0a2c971eb36'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:16.463074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] The token cache is being invalidate because project 53e787dbbd234a98950197aea08d22a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:16.463428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:16.464093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:16.465974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1103/2196] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:16 2022] DELETE /identity/v3/projects/53e787dbbd234a98950197aea08d22a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:16.466872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.467933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.521080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1094/2197] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.523790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f91-46a5-48fd-9131-747ff00230c4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.524080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f91-46a5-48fd-9131-747ff00230c4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.531675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f91-46a5-48fd-9131-747ff00230c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.544513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9987d-0ae2-4311-812a-a0a2c971eb36 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.549466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.550096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.550458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.550742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.551378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.551633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-829c4f91-46a5-48fd-9131-747ff00230c4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.552835 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-829c4f91-46a5-48fd-9131-747ff00230c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.553316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.561228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1095/2198] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.562327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.562614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.562885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.582561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1104/2199] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:16.583648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.586386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.587651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.588864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.606816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1096/2200] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.606816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.619502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c9a2-1b23-4604-9c77-7f9c4d2b0403 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.624049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.624688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.624965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.625233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.625885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:16.626215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.627802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.642201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1097/2201] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:16.642958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.657186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f27f4-3da2-4c67-af6a-b85b7aa95587 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.663788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.664167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb2eff-d184-49b3-955f-49b39c525bb2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.664292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.664593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.664934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.665757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.667380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b0df5-289d-4745-914c-1a2271355c2a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.668623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.669434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.669668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.670046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.683695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1098/2202] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:16.683695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.683695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.684028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.685368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.686972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.699044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1105/2203] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:16.699927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.712015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e2e90-a3ae-42b8-86ca-7d01e893c54e service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.719047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.720184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.720500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.720834 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.721527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.723858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff585-4813-4a83-af9c-a95779333537 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.735673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.736903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.750451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1099/2204] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.751472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.764862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7144a78-a55c-433b-8b7a-afe86031b9da None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.771123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.773288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.773851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.774345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] PATH_INFO: `/v3/projects/4e651321a06547dd9d7740f9398f41f2/users/173ae7aae8ff4981821a9b2a4425b961/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.777894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1106/2205] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:16.777894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.777894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.777894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.798795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e651321a06547dd9d7740f9398f41f2, user_id=173ae7aae8ff4981821a9b2a4425b961, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.802591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.812639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] MFA Rules not processed for user `3e981040f515413f95d7114dab9a243f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:16.813958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:16.825779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:16.826624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1100/2206] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:16 2022] PUT /identity/v3/projects/4e651321a06547dd9d7740f9398f41f2/users/173ae7aae8ff4981821a9b2a4425b961/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:16.827719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.902549 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:16.918953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833fd54-6cd3-4578-befd-1dd2a351ba29 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.925120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.925749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.926032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.926454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.927117 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:16.927486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.929657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.942981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1107/2207] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:16.945406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.950052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1101/2208] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:16.951113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.966102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731334-23ba-4c99-a903-b65dd69feb48 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:16.971476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:16.972476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:16.972810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:16.973095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:16.973866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:16.976408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:16.990637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1102/2209] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:16.992352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:16.994710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:17.057490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4e43f-3683-42d2-98f1-9ff388622b65 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.064955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.065743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de59b3-ed1a-4b71-bc98-3a8d8e739847 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.065867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.066227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.066689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.067515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.070588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.071366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.072042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.072381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.072668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.096452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1108/2210] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:16 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:17.097379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.114216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f5edd-4ff7-4df7-a3bc-d52b4a05d154 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.122963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.124112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.124662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.125068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.126052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.128857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.151964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.153602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.164561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1109/2211] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:17 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:17.164561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.167147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1103/2212] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:17.169986 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.182857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1479332-51f1-4daa-ac9b-0bcd04e14711 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.254035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebee2-4e06-4ed6-b6f9-7dec1cdac88e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.262047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.262823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.263169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.263527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] PATH_INFO: `/v3/projects/4e651321a06547dd9d7740f9398f41f2/users/173ae7aae8ff4981821a9b2a4425b961/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.265936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e651321a06547dd9d7740f9398f41f2, user_id=173ae7aae8ff4981821a9b2a4425b961, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.267459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.267991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.268430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.268763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.269544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.269876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.271576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.284414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1104/2213] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:17.285150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.294171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1110/2214] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:17 2022] PUT /identity/v3/projects/4e651321a06547dd9d7740f9398f41f2/users/173ae7aae8ff4981821a9b2a4425b961/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:17.295662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.309258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cddcb0-3c74-4177-a23a-28b6823fc041 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.318953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:17.347427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:17.410280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75b904-c72e-44eb-80fa-ddadf57ce0d3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.417269 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.418440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.419360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.420168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.422733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.425139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.425922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.426665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.426665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.427139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.428071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.430840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e6f04-b53d-47e9-ab93-8ce4f1413b12 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.458634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1111/2215] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:17.460031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eee21-a50d-4684-9048-0162dfbfabfc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.460368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eee21-a50d-4684-9048-0162dfbfabfc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.460648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eee21-a50d-4684-9048-0162dfbfabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.469081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1105/2216] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:17 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:17.470320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.493702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc749bb-3485-45a1-a27d-828f4d8b9b37 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.504872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.505548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.505828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.506122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] PATH_INFO: `/v3/projects/a469c32cb44e47f69ac362311e1719ec/users/a059bfaf2241471eab5753144129cb68/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.513793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cd4eee21-a50d-4684-9048-0162dfbfabfc None None] MFA Rules not processed for user `173ae7aae8ff4981821a9b2a4425b961`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:17.515184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cd4eee21-a50d-4684-9048-0162dfbfabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:17.537565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a469c32cb44e47f69ac362311e1719ec, user_id=a059bfaf2241471eab5753144129cb68, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.553233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.589247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1106/2217] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:17 2022] PUT /identity/v3/projects/a469c32cb44e47f69ac362311e1719ec/users/a059bfaf2241471eab5753144129cb68/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:17.593055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.630346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1112/2218] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:17.630346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.630346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.630346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.672406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:17.673655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:17.752464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050c6f-0c52-4335-b9c5-80b16616cf6f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.767057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.767715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.768001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.768277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.768935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.770586 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.793721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1107/2219] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:17.795561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.819783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1113/2220] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:17.819783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.839693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4f94-e73e-4609-8092-8dd34f413ede None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.870224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.870925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.871245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.871531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.872250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:17.874464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:17.889814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1114/2221] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:17.890967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:17.915500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa854741-3821-45d6-ac0c-4c504642ce03 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.919914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.920617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.920899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.921174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:17.930374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:17.976988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:17.978449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530747-b65a-4286-b07d-325ba8632351 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:17.988243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:17.988764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:17.989061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:17.989369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.008675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:18.011897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:18.018468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:18.024164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:18.044892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1115/2222] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:18.051231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1108/2223] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:18.066380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:18.088282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c64f7e-e069-4e2b-a769-adb0d40805e6 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:18.096757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:18.097353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:18.097628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:18.097895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] PATH_INFO: `/v3/projects/01a29ae6853c465b9a07c693db3af786/users/41b9798ed3904162b6dfd473f68fca49/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.138858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a29ae6853c465b9a07c693db3af786, user_id=41b9798ed3904162b6dfd473f68fca49, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:18.144170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163679b6-31da-4efd-a42b-622fed50cb3c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:18.169320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:18.174852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1116/2224] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:18 2022] PUT /identity/v3/projects/01a29ae6853c465b9a07c693db3af786/users/41b9798ed3904162b6dfd473f68fca49/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:18.181870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:18.183912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:18.185169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.189649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0893c6-3d69-4804-adb6-0de9be31951a service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:18.234184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:18.238460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:18.296186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:18.296821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:18.302098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:18.302961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.308004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:18.355604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1117/2225] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:18.395117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:18.397092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:18.452280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:18.453873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c2230-981b-4d21-bc67-716c8df23d8b service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:18.477180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1109/2226] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:18.494691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209da9-771a-4975-8bc4-e3fea4844c84 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:18.509840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:18.511331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:18.511764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:18.512315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.531036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:18.533014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:18.545255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1118/2227] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:18.858997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1fc-03b1-4fb6-b977-d92ad699e53d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:18.859508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1fc-03b1-4fb6-b977-d92ad699e53d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:18.859609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1fc-03b1-4fb6-b977-d92ad699e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:18.898821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6565a1fc-03b1-4fb6-b977-d92ad699e53d None None] MFA Rules not processed for user `3e981040f515413f95d7114dab9a243f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:18.903470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6565a1fc-03b1-4fb6-b977-d92ad699e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:18.979429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:19.004074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021cb79-8d92-412a-a713-b942baaddc03 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:19.024127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:19.030600 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:19.030911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:19.031164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] PATH_INFO: `/v3/users/8243650e772b4b619216ada663df9fce` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:19.036897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8243650e772b4b619216ada663df9fce)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:19.046615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:19.121330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1110/2228] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:19.163944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:19.174186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8243650e772b4b619216ada663df9fce'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:19.210169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8243650e772b4b619216ada663df9fce'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:19.225121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8243650e772b4b619216ada663df9fce'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:19.226516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8243650e772b4b619216ada663df9fce'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:19.237787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8243650e772b4b619216ada663df9fce'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:19.257624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015630-4545-4618-abf2-77523600947c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:19.258221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015630-4545-4618-abf2-77523600947c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:19.258329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1119/2229] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:18 2022] DELETE /identity/v3/users/8243650e772b4b619216ada663df9fce => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:19.258509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015630-4545-4618-abf2-77523600947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:19.281763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-62015630-4545-4618-abf2-77523600947c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:19.283042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-62015630-4545-4618-abf2-77523600947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:19.325316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:19.378244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1111/2230] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:19.402541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:19.405334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:19.548777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2ec35-85aa-4a06-9ed1-99b42df6bb0d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:19.553186 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:19.553845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:19.554150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:19.554425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:19.565060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:19.567487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:19.581461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1120/2231] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:19.605626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:19.605922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:19.606240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:19.672237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] MFA Rules not processed for user `a059bfaf2241471eab5753144129cb68`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:19.674165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:19.836175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1112/2232] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:19.842480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:19.844747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:19.965034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993fe37-e451-4ded-8b89-7e02c1429ba8 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:19.981694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:19.982404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:19.983191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:19.983191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:20.003079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:20.004562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:20.024212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1121/2233] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:20.643361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:20.645071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:20.670018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2f8ac-f986-451f-97e9-55839947b080 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:20.681547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:20.683457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:20.684055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:20.685215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] PATH_INFO: `/v3/projects/562cda60de104cfeb2f33b5e7161ca43` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:20.688257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562cda60de104cfeb2f33b5e7161ca43)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:20.690718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:20.822924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562cda60de104cfeb2f33b5e7161ca43', 'request_id': 'req-8f7b61c8-232e-4d26-b10d-32c157af4967'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.831923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562cda60de104cfeb2f33b5e7161ca43', 'request_id': 'req-8f7b61c8-232e-4d26-b10d-32c157af4967'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.847247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562cda60de104cfeb2f33b5e7161ca43', 'request_id': 'req-8f7b61c8-232e-4d26-b10d-32c157af4967'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.867545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] The token cache is being invalidate because project 562cda60de104cfeb2f33b5e7161ca43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:20.869030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.870106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8f7b61c8-232e-4d26-b10d-32c157af4967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:20.877347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1113/2234] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:20 2022] DELETE /identity/v3/projects/562cda60de104cfeb2f33b5e7161ca43 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:20.878945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:20.899387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9f3d-94dd-4b36-80a6-9f5c8d6b0408 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:21.038792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:21.040184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:21.040690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:21.041112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] PATH_INFO: `/v3/users/173ae7aae8ff4981821a9b2a4425b961` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:21.045103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173ae7aae8ff4981821a9b2a4425b961)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:21.048452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:21.067990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:21.207297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173ae7aae8ff4981821a9b2a4425b961'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.244231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173ae7aae8ff4981821a9b2a4425b961'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.255190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173ae7aae8ff4981821a9b2a4425b961'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.256449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173ae7aae8ff4981821a9b2a4425b961'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.279811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173ae7aae8ff4981821a9b2a4425b961'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:21.292019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1122/2235] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:20 2022] DELETE /identity/v3/users/173ae7aae8ff4981821a9b2a4425b961 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:21.713812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e49-9577-493b-95a4-59d2b2d8fb6e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:21.714321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e49-9577-493b-95a4-59d2b2d8fb6e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:21.714442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51714e49-9577-493b-95a4-59d2b2d8fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:21.740695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-51714e49-9577-493b-95a4-59d2b2d8fb6e None None] MFA Rules not processed for user `a059bfaf2241471eab5753144129cb68`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:21.743024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-51714e49-9577-493b-95a4-59d2b2d8fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:21.820663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:21.844891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1114/2236] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:22.411326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:22.413355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:22.575249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c35fcd-0e51-42c5-a582-f3e0a46cdb54 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:22.583144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:22.583911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:22.584280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:22.585214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] PATH_INFO: `/v3/projects/4e651321a06547dd9d7740f9398f41f2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:22.586608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e651321a06547dd9d7740f9398f41f2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:22.589114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:22.698910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e651321a06547dd9d7740f9398f41f2', 'request_id': 'req-8e0e7fee-d664-4619-a03f-6190ff0221d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:22.712145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e651321a06547dd9d7740f9398f41f2', 'request_id': 'req-8e0e7fee-d664-4619-a03f-6190ff0221d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:22.727007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e651321a06547dd9d7740f9398f41f2', 'request_id': 'req-8e0e7fee-d664-4619-a03f-6190ff0221d2'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:22.743075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] The token cache is being invalidate because project 4e651321a06547dd9d7740f9398f41f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:22.744235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:22.745226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8e0e7fee-d664-4619-a03f-6190ff0221d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:22.749784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1123/2237] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:22 2022] DELETE /identity/v3/projects/4e651321a06547dd9d7740f9398f41f2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:22.754424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:22.754954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:22.754954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:22.784858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:22.786876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:22.929412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1115/2238] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:22.943894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:22.944682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:22.944955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:22.986905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:22.991763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:23.012486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1124/2239] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:23.016430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.035226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653e04-dadc-48c1-9b29-077aa6bd47d7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.045318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.046702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.046702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.046947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.048462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:23.048785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.052348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.101502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1116/2240] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:44:23.101821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.119914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1a559-c3d4-41b0-926e-c876de5b0e3c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.125998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.127494 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.127879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.128241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.129025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.133096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.142761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:23.194135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.201856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1125/2241] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:23 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:23.208191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac854819-5b83-4b10-8156-045161edc7eb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.314916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.315584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.315948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.316102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.316744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.321370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.374643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1117/2242] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:23 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:23.378147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.395543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8b072-391c-4c30-9843-772e3c146a08 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.405057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.405857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.406310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.406585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.407320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.410505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.442373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1126/2243] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:23.443758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.463541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20517de4-72c2-474e-8196-accbb5187164 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.469357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.469980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.470295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.470719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.471403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.473047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0b553-f0ed-4663-ac86-1081c35313a0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.497391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1118/2244] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:23.498953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:23.516379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f10f0-ba3a-44b1-94d9-5b422734826f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:23.534265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:23.535026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.535898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.536194 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] PATH_INFO: `/v3/projects/43260d8a0a9b4f3c879c101ccf8157f7/users/9264fda1990c4a1abc287c0fe4b2affd/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.584910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43260d8a0a9b4f3c879c101ccf8157f7, user_id=9264fda1990c4a1abc287c0fe4b2affd, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:23.602604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:23.664038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1127/2245] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:23 2022] PUT /identity/v3/projects/43260d8a0a9b4f3c879c101ccf8157f7/users/9264fda1990c4a1abc287c0fe4b2affd/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:23.665099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:23.665396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:23.665675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:23.754341 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] MFA Rules not processed for user `9264fda1990c4a1abc287c0fe4b2affd`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:23.756171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:23.967794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:24.011810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1119/2246] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:24.025956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:24.028276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:24.204042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daea06-a9b0-4e03-ad4e-4283e6765994 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:24.215938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:24.217653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:24.220824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:24.220824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:24.257259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:24.261032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d4cc-ed77-4e2a-911d-baa61869ec54 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:24.288961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1128/2247] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:24.326732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:24.501015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539e82c-a91d-4460-a380-91c26212c54a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:24.516495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:24.517725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:24.518657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:24.518657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] PATH_INFO: `/v3/users/9264fda1990c4a1abc287c0fe4b2affd` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:24.520470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9264fda1990c4a1abc287c0fe4b2affd)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:24.530611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:24.657808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9264fda1990c4a1abc287c0fe4b2affd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:24.675750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9264fda1990c4a1abc287c0fe4b2affd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:24.705037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9264fda1990c4a1abc287c0fe4b2affd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:24.707510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9264fda1990c4a1abc287c0fe4b2affd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:24.727485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9264fda1990c4a1abc287c0fe4b2affd'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:24.740085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1120/2248] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:44:24 2022] DELETE /identity/v3/users/9264fda1990c4a1abc287c0fe4b2affd => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:24.745480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6a5a-658d-4515-bd63-f372812bf2a7 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:24.746002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6a5a-658d-4515-bd63-f372812bf2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:24.746100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6a5a-658d-4515-bd63-f372812bf2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:24.779921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9c3f6a5a-658d-4515-bd63-f372812bf2a7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:24.781202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9c3f6a5a-658d-4515-bd63-f372812bf2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:24.972750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1129/2249] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:25.013848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:25.016628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:25.213962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9b08-93c1-452c-9b24-de2f61ffdc7e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:25.232233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:25.233037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:25.233388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:25.233898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:25.275205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:25.279167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:25.321344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1121/2250] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:26.928148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:26.929305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:26.929305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.003560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] MFA Rules not processed for user `6d498f9f15a84f4489c2c3f2eab74781`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:27.004826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:27.082237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:27.125626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1130/2251] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:27.131283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.134800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:27.153967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeec4f4-10d9-4037-b815-25481ddbd351 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.161047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.161757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.163142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.163597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.164594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.167049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:27.181073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:27.228340 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.240490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1122/2252] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:27 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:27.246526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27e40b-77e4-4c67-9923-61e8cccb2af9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.474601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.477133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.477133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.477133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.477610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.482350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:27.529473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1131/2253] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:27 2022] POST /identity/v3/users => generated 298 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:27.533382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.548325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf81665-c723-472b-94c5-7e0417f72884 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.554369 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.555124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.555471 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.555904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.556539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.559128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:27.573593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1123/2254] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:27.584055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.599295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147022f-37a7-4cda-b8d7-4489c51571c8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.616075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.616560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.616839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.617113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] PATH_INFO: `/v3/projects/a049302ab3604865893306a2095c365d/users/e6c7519d49f44620853bce57ec87d7eb/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.659034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a049302ab3604865893306a2095c365d, user_id=e6c7519d49f44620853bce57ec87d7eb, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.661841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:27.689883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1132/2255] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:27 2022] PUT /identity/v3/projects/a049302ab3604865893306a2095c365d/users/e6c7519d49f44620853bce57ec87d7eb/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:27.694526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.740700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa383ea-4bf9-47aa-b425-1c7ecc5a08c6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.928360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.929272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.929562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.929885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.930730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.932716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:27.951801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1124/2256] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:27.952783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:27.967180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f5d26-8827-4029-ae0e-54213623e1c1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:27.972474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:27.973394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:27.973822 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:27.974285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] PATH_INFO: `/v3/projects/a049302ab3604865893306a2095c365d/users/e6c7519d49f44620853bce57ec87d7eb/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:27.976829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a049302ab3604865893306a2095c365d, user_id=e6c7519d49f44620853bce57ec87d7eb, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:27.980082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f76b90-2a1c-4bdc-b0bd-a41dcc4026de admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:28.001229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1133/2257] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:27 2022] PUT /identity/v3/projects/a049302ab3604865893306a2095c365d/users/e6c7519d49f44620853bce57ec87d7eb/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:28.084524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:28.086435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:28.099960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cae8-a6c2-4d87-b146-70c377298e80 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:28.229932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:28.232025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:28.232615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:28.233290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] PATH_INFO: `/v3/projects/43260d8a0a9b4f3c879c101ccf8157f7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:28.235666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43260d8a0a9b4f3c879c101ccf8157f7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:28.239363 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:28.365161 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43260d8a0a9b4f3c879c101ccf8157f7', 'request_id': 'req-54d7ca00-72a3-48e3-802b-2e87ad8c7034'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:28.380017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43260d8a0a9b4f3c879c101ccf8157f7', 'request_id': 'req-54d7ca00-72a3-48e3-802b-2e87ad8c7034'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:28.408321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43260d8a0a9b4f3c879c101ccf8157f7', 'request_id': 'req-54d7ca00-72a3-48e3-802b-2e87ad8c7034'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:28.430434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] The token cache is being invalidate because project 43260d8a0a9b4f3c879c101ccf8157f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:44:28.431212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:28.432072 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-54d7ca00-72a3-48e3-802b-2e87ad8c7034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:44:28.437748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1125/2258] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:44:28 2022] DELETE /identity/v3/projects/43260d8a0a9b4f3c879c101ccf8157f7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:44:28.439471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:28.439826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:28.440094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:28.482890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:28.484589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:28.622005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1134/2259] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:28.631115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:28.631690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:28.633142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:28.650894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:28.671014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:28.673904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:28.690855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1126/2260] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:44:28.695313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:28.713319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e469f9c-cbf3-478e-b7e7-dc281b9a3595 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:28.717443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:28.718208 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:28.718722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:28.719092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:28.720991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:44:28.721546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:28.723830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:28.749432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1135/2261] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:44:28.753587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:28.768382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1433bc7-0226-4274-adfd-94bdc1bba697 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:28.786587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:28.788222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:28.788570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:28.789494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:28.790511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:28.793031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:28.837714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1127/2262] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:44:28.842506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:28.865229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93315afc-e136-49d2-b29e-f4cfe9a3abd8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:28.950277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:29.057480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:29.058410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.058870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.059596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.060536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:29.062947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:29.138549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1136/2263] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:44:28 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:44:29.139750 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:29.154971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0033ba-5109-4ddd-824e-c8710a87f185 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:29.162423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:29.163623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.164125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.164794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.165659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:29.168111 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:29.185545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1128/2264] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:29.190258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:29.206856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533bab9-e097-4eb8-9e3d-de086384229b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:29.218023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:29.219497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.219885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.220299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.221343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:29.223320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abca652-69d7-4d19-8d94-8ada2d200ecb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:29.282354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1137/2265] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:44:29.287032 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:29.305813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c67b-e8ec-4733-9ccb-030d4931276a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:29.320447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:29.323133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.325119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.326865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] PATH_INFO: `/v3/projects/fdfef18d2e5546bab47bdd82c7488c49/users/79fa9e070f2e4d5aaef216adf84ecf9a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.370048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfef18d2e5546bab47bdd82c7488c49, user_id=79fa9e070f2e4d5aaef216adf84ecf9a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:29.375863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:29.406451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1129/2266] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:44:29 2022] PUT /identity/v3/projects/fdfef18d2e5546bab47bdd82c7488c49/users/79fa9e070f2e4d5aaef216adf84ecf9a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:44:29.416984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7e99-7335-4ef7-b021-29a7e9c2588d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.417270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7e99-7335-4ef7-b021-29a7e9c2588d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.417544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7e99-7335-4ef7-b021-29a7e9c2588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.477212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1cbd7e99-7335-4ef7-b021-29a7e9c2588d None None] MFA Rules not processed for user `79fa9e070f2e4d5aaef216adf84ecf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:29.478536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1cbd7e99-7335-4ef7-b021-29a7e9c2588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:29.663509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1138/2267] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:29.673744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:29.678960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:29.821093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b08cc-38cd-4af7-bf5f-6830bd1e3d17 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:29.832396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:29.833490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:29.833596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:29.835088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:29.849611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:29.852584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:29.866382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1130/2268] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:31.817392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f67e5e-922c-4007-84ef-08c7915d501a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:31.817926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f67e5e-922c-4007-84ef-08c7915d501a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:31.817926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f67e5e-922c-4007-84ef-08c7915d501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:31.918490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-87f67e5e-922c-4007-84ef-08c7915d501a None None] MFA Rules not processed for user `41b9798ed3904162b6dfd473f68fca49`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:31.919788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-87f67e5e-922c-4007-84ef-08c7915d501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:32.130548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1139/2269] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:32.470361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:32.471920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:32.660996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbb1f3-42dd-46af-b82a-704548f58e67 service glance] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:32.682196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:32.682196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:32.682196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:32.682827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:32.734377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:32.736338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f35214-2932-4a89-b7b2-2a46d091c658 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:32.767676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1131/2270] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:44:35.549045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad339ed-7e9b-4aba-b5c1-451dac8fea99 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:35.549588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad339ed-7e9b-4aba-b5c1-451dac8fea99 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:35.549588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad339ed-7e9b-4aba-b5c1-451dac8fea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:35.578546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4ad339ed-7e9b-4aba-b5c1-451dac8fea99 None None] MFA Rules not processed for user `41b9798ed3904162b6dfd473f68fca49`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:35.580549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4ad339ed-7e9b-4aba-b5c1-451dac8fea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:35.589700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1140/2271] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:37.114619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:37.115706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:37.115706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:37.175874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:37.206842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] MFA Rules not processed for user `e6c7519d49f44620853bce57ec87d7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:37.208422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:37.307952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1132/2272] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:45.571698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:46.598023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bd65-b0d7-43dc-b707-2d4bcd9cb033 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:46.598712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bd65-b0d7-43dc-b707-2d4bcd9cb033 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:46.598712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714bd65-b0d7-43dc-b707-2d4bcd9cb033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:46.618379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b714bd65-b0d7-43dc-b707-2d4bcd9cb033 None None] MFA Rules not processed for user `3e981040f515413f95d7114dab9a243f`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:46.619631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b714bd65-b0d7-43dc-b707-2d4bcd9cb033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:46.680218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1141/2273] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:47.303256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=30 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:44:50.651553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:50.653445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:50.665914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b262c0-3c1e-47c6-9c52-b78124dd948b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:50.669448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:50.670060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:50.670397 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:50.670669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:50.672404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:50.731445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:50.732879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:50.742369 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1133/2274] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:44:50.949499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4580-d105-45f3-979d-9b144561f56f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:50.949913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4580-d105-45f3-979d-9b144561f56f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:50.950046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4580-d105-45f3-979d-9b144561f56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:50.970804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ba3d4580-d105-45f3-979d-9b144561f56f None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:44:50.972056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba3d4580-d105-45f3-979d-9b144561f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:51.032126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1142/2275] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:44:51.079951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:44:51.081382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:44:51.187650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f69cb-4697-44f2-86a5-ab709c688049 service glance] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:44:51.194313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:44:51.195021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:44:51.195274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:44:51.195551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:44:51.206247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:44:51.208324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:44:51.219912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1134/2276] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:44:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:45:01.025418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=50 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:01.214344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=60 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:02.926975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fb93-3131-4ea5-81e9-90a6c9dde2f4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:02.927884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fb93-3131-4ea5-81e9-90a6c9dde2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:02.928147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659fb93-3131-4ea5-81e9-90a6c9dde2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:02.950461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e659fb93-3131-4ea5-81e9-90a6c9dde2f4 None None] MFA Rules not processed for user `6d498f9f15a84f4489c2c3f2eab74781`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:02.951646 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e659fb93-3131-4ea5-81e9-90a6c9dde2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:02.969127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1143/2277] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:09.389212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.390769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:09.458184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a787-2076-479f-a611-6f20f6ede8ef service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.462587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.463213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.463487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.463754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] PATH_INFO: `/v3/users/c9e7787d1559495895b93c06ab84dfac` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.464853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e7787d1559495895b93c06ab84dfac)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.466798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.517623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e7787d1559495895b93c06ab84dfac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:09.525242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e7787d1559495895b93c06ab84dfac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:09.537875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e7787d1559495895b93c06ab84dfac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:09.538630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e7787d1559495895b93c06ab84dfac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:09.546236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e7787d1559495895b93c06ab84dfac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:09.552300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1135/2278] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:09 2022] DELETE /identity/v3/users/c9e7787d1559495895b93c06ab84dfac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:09.556857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.557331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.557425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.576222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:09.577431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:09.639608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1144/2279] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:09.649938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:09.651406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:09.717860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e01023-ed4b-461e-98a3-3143762b1f86 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:09.721699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:09.722342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:09.722624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:09.722898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:09.733201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:09.734678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111df4d3-2d91-4c57-98b9-40cb8e1523a1 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:09.744957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1136/2280] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:10.175318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:10.177399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:10.189651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764ffa8-f49f-4cca-91d0-8ee870301cf1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:10.195150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:10.195852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:10.196207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:10.197515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] PATH_INFO: `/v3/projects/131c8cf3f49b4a9e9ac7c7df21cc4f36` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:10.198797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=131c8cf3f49b4a9e9ac7c7df21cc4f36)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:10.201226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:10.262319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131c8cf3f49b4a9e9ac7c7df21cc4f36', 'request_id': 'req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:10.269209 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131c8cf3f49b4a9e9ac7c7df21cc4f36', 'request_id': 'req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:10.278095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131c8cf3f49b4a9e9ac7c7df21cc4f36', 'request_id': 'req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:10.289250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] The token cache is being invalidate because project 131c8cf3f49b4a9e9ac7c7df21cc4f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:10.289538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:10.290222 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:10.291927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1145/2281] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:10 2022] DELETE /identity/v3/projects/131c8cf3f49b4a9e9ac7c7df21cc4f36 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:14.583771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:14.584803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:14.585322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:14.606213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:14.607588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:14.625127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:14.680828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1137/2282] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:14.694004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:14.695619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:14.794110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf9bc6-6cb2-422d-9296-dbf82c0caf4b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:14.802051 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:14.802724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:14.803002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:14.803270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:14.812473 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:14.814566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15859600-78bd-489a-af9e-410fc30f29b2 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:14.823616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1146/2283] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:45:16.077937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:16.079594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:16.157033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0069a-dc16-4c6c-98e7-3156a7d66d0f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:16.162251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:16.162895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.163168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.163452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] PATH_INFO: `/v3/users/79fa9e070f2e4d5aaef216adf84ecf9a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.164706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fa9e070f2e4d5aaef216adf84ecf9a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:16.166510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:16.230536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fa9e070f2e4d5aaef216adf84ecf9a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.237781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fa9e070f2e4d5aaef216adf84ecf9a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.261396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fa9e070f2e4d5aaef216adf84ecf9a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.262219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fa9e070f2e4d5aaef216adf84ecf9a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.272529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fa9e070f2e4d5aaef216adf84ecf9a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.279073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1138/2284] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:16 2022] DELETE /identity/v3/users/79fa9e070f2e4d5aaef216adf84ecf9a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:16.283754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.284302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.284302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.299765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:16.306034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:16.308032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:16.371333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1147/2285] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:16.381805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:16.383216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:16.437430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:16.444401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b453c4-1b52-408f-bf09-f021f09346db admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:16.448596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:16.449202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.449482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.449755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.459344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:16.460771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a42346-ca6c-4cb7-a2a4-8684c6757b4b service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:16.470557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1139/2286] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:16.798741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:16.800348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:16.813958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9949481-ca67-4f39-955e-03fd597ff093 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:16.819566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:16.820233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.820583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.820926 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] PATH_INFO: `/v3/projects/fdfef18d2e5546bab47bdd82c7488c49` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.822583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfef18d2e5546bab47bdd82c7488c49)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:16.824265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:16.908567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfef18d2e5546bab47bdd82c7488c49', 'request_id': 'req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.916048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfef18d2e5546bab47bdd82c7488c49', 'request_id': 'req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.926218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfef18d2e5546bab47bdd82c7488c49', 'request_id': 'req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.940697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] The token cache is being invalidate because project fdfef18d2e5546bab47bdd82c7488c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:16.941004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.941799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-326fbd73-7d96-46f8-a254-3dd0bfd3c4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:16.944722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1148/2287] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:16 2022] DELETE /identity/v3/projects/fdfef18d2e5546bab47bdd82c7488c49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:16.950051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:16.950723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:16.951040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:16.988495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:16.989788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.060865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1140/2288] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:17.070107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.070338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.070613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.092967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:17.094303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.104068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1149/2289] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:17.108526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.119465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56953ee-398d-468f-8d71-b79192c3c9e3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.124531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.125162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.125450 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.125725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.126432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:17.126742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.128665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.142488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1141/2290] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:17.147421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.157462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e8b25-5207-4bf2-99f7-60e991dd9a1c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.170098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.170735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.171009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.171347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.172063 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.174288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.204493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1150/2291] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:17 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:17.209237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.220290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208be6-d53d-4bec-a5c9-db6a8663bc3b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.289289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.290275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.290596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.290883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.291601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.293573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.321465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1142/2292] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:17 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:17.322659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.334550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb72a6-fb8c-42cc-aab2-b0eee4406ebf admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.339791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.340413 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.340720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.340994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.341651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.343350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.354784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1151/2293] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:45:17.359256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.369315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48879e2-1d54-4ef1-bbb5-f6695d89eb35 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.374010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.374654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.374935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.375209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.375857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.377686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0554a-d085-438c-bcdc-94d8163a3534 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.394120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1143/2294] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:17.397987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.409254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899fb25-2111-479c-b5d4-5457bb48da03 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.414661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.415279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.415742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.415976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] PATH_INFO: `/v3/projects/14adfadd0b794bab951cbdb03489c28a/users/bb04ef9179d44d8ea6393673c8050542/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.433950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14adfadd0b794bab951cbdb03489c28a, user_id=bb04ef9179d44d8ea6393673c8050542, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.436647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.451353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1152/2295] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:17 2022] PUT /identity/v3/projects/14adfadd0b794bab951cbdb03489c28a/users/bb04ef9179d44d8ea6393673c8050542/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:17.462899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.463195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.463476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.492084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] MFA Rules not processed for user `bb04ef9179d44d8ea6393673c8050542`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:17.493313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.543425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:17.565839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1144/2296] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:17.578527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:17.580410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:17.613029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:17.644173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd57fa-13a3-4a4d-ac0f-8661ac8c33e1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:17.647994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:17.648611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:17.648890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:17.649161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:17.658808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:17.660663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544bc8f-fbdb-4e9f-9ba7-e3753e701315 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:17.671399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1153/2297] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:27.562915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:27.666603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=14 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:36.798330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:36.866827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d00d5-a6e2-4e9a-bd69-56d06121bed6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:36.871324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:36.871957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:36.872233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:36.872500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] PATH_INFO: `/v3/users/bb04ef9179d44d8ea6393673c8050542` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:36.873615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb04ef9179d44d8ea6393673c8050542)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:36.875615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:36.930723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb04ef9179d44d8ea6393673c8050542'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:36.937859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb04ef9179d44d8ea6393673c8050542'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:36.950538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb04ef9179d44d8ea6393673c8050542'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:36.951268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb04ef9179d44d8ea6393673c8050542'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:36.959531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb04ef9179d44d8ea6393673c8050542'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:36.967088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1145/2298] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:36 2022] DELETE /identity/v3/users/bb04ef9179d44d8ea6393673c8050542 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:36.971786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:36.972594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:36.973168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:36.993181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:36.994548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:37.059402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1154/2299] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:37.070025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:37.071509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:37.131878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38809a-4747-4ecf-a28c-fbb213a94727 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:37.138728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:37.139347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.139814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.140098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.150013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.151338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a053e52-35ce-428b-8e64-ad2ec7279ea6 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.161437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1146/2300] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:37.603629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:37.605575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:37.622690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070c94e-5f7f-4836-983c-3d12056270c0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:37.628700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:37.629617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.630020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.630354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] PATH_INFO: `/v3/projects/14adfadd0b794bab951cbdb03489c28a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.631868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14adfadd0b794bab951cbdb03489c28a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.633850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.688846 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14adfadd0b794bab951cbdb03489c28a', 'request_id': 'req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:37.695370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14adfadd0b794bab951cbdb03489c28a', 'request_id': 'req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:37.703592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14adfadd0b794bab951cbdb03489c28a', 'request_id': 'req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:37.715383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] The token cache is being invalidate because project 14adfadd0b794bab951cbdb03489c28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:37.716121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:37.716400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bae5a3f7-bdd2-45a6-b713-d66a0deb5784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:37.718153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1155/2301] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:37 2022] DELETE /identity/v3/projects/14adfadd0b794bab951cbdb03489c28a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:45:37.723402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.723694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.723965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.749197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:37.750714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:37.772327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:37.823978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1147/2302] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:37.832183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.834109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.834109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.860176 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:37.861405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:37.873499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1156/2303] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:37.877940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:37.888379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda0d8c-c1b6-4f43-a71b-402abac4bf3a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:37.899391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:37.901585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.902259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.902719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.903542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:45:37.904022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.906165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.926396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1148/2304] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:45:37.928717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:37.940019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd50b-a4d7-4fa6-a76f-672d12d141af None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:37.947660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:37.948273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:37.948546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:37.948823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:37.949446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:37.951395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:37.987658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1157/2305] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:45:37 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:45:37.992138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.005198 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18119a-7863-4214-a06f-5ac3212670ba admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.084921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.085922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.086413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.086973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.087782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.089958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.120983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1149/2306] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:45:37 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:45:38.121766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.145009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0a02-4017-45f3-81e5-8ffe98b1143c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.153787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.156445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.156899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.157172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.157858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.159740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.176968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.178285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1158/2307] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:38.197825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200888d5-b4f6-4376-9d4d-7dc0eb07ba48 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.202615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.203237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.203516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.203794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.204691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.206913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f30e17-e0e6-4e3e-90af-f4a883a7b462 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.222916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1150/2308] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:45:38.227097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.237078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c367f8-7bd9-4a7a-b8af-c1b423726606 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.241696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.242363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.242640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.242909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] PATH_INFO: `/v3/projects/81ced134027f4590af33e5ce82c1745c/users/cd257d09786e4ac9bc6650af58331229/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.258238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ced134027f4590af33e5ce82c1745c, user_id=cd257d09786e4ac9bc6650af58331229, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.260880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.275405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1159/2309] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:45:38 2022] PUT /identity/v3/projects/81ced134027f4590af33e5ce82c1745c/users/cd257d09786e4ac9bc6650af58331229/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:38.287265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84faaee-9811-480c-bd85-d628f11211db None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.287670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84faaee-9811-480c-bd85-d628f11211db None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.288026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84faaee-9811-480c-bd85-d628f11211db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.316965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e84faaee-9811-480c-bd85-d628f11211db None None] MFA Rules not processed for user `cd257d09786e4ac9bc6650af58331229`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:38.318252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e84faaee-9811-480c-bd85-d628f11211db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:38.383038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1151/2310] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:38.394892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:38.396682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:38.420783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:38.464201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90877a0-609f-4ab8-80c5-c370c99b3e24 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:38.469187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:38.469802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:38.470103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:38.470406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:38.482910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:38.484366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d27b82-b165-4497-8f8b-ba19fa52f350 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:38.494839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1160/2311] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:43.613195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84faaee-9811-480c-bd85-d628f11211db None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:43.634342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:43.698542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84faaee-9811-480c-bd85-d628f11211db None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:43.703421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:43.703421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.704172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.704172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] PATH_INFO: `/v3/users/cd257d09786e4ac9bc6650af58331229` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:43.707601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd257d09786e4ac9bc6650af58331229)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:43.707761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:43.764619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd257d09786e4ac9bc6650af58331229'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:43.772235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd257d09786e4ac9bc6650af58331229'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:43.784625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd257d09786e4ac9bc6650af58331229'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:43.785374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd257d09786e4ac9bc6650af58331229'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:43.793216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd257d09786e4ac9bc6650af58331229'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:43.800033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1152/2312] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:45:43 2022] DELETE /identity/v3/users/cd257d09786e4ac9bc6650af58331229 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:43.805120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.805607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.805746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:43.827408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:43.828661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:43.898906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1161/2313] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:43.909865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:43.911739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:43.983304 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a303a-3c3d-4e86-9bb4-cfb7e92c6200 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:43.998362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:43.999007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:43.999288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:43.999617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.014485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.016482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6372bb-c5a1-4ead-8b13-44a2d9f1bfbb service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.031265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1153/2314] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:44.460418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:44.462444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.478873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6065481-b039-46fe-b2de-a979866590b0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:44.484897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:44.485976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.486384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.486751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] PATH_INFO: `/v3/projects/81ced134027f4590af33e5ce82c1745c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.489639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ced134027f4590af33e5ce82c1745c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:44.492869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:44.554240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ced134027f4590af33e5ce82c1745c', 'request_id': 'req-a9103ede-698d-4d55-b6e6-742136fc0ff0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.561157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ced134027f4590af33e5ce82c1745c', 'request_id': 'req-a9103ede-698d-4d55-b6e6-742136fc0ff0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.569917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ced134027f4590af33e5ce82c1745c', 'request_id': 'req-a9103ede-698d-4d55-b6e6-742136fc0ff0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.582308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] The token cache is being invalidate because project 81ced134027f4590af33e5ce82c1745c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:45:44.582595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.583253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:45:44.584779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1162/2315] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:45:44 2022] DELETE /identity/v3/projects/81ced134027f4590af33e5ce82c1745c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:45:44.894906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783c42-12b5-4581-a4c3-d5256a17e59a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:44.895467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783c42-12b5-4581-a4c3-d5256a17e59a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:44.895594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a783c42-12b5-4581-a4c3-d5256a17e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:44.916236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2a783c42-12b5-4581-a4c3-d5256a17e59a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:44.917462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a783c42-12b5-4581-a4c3-d5256a17e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:44.973249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:45.000082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1154/2316] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:45.021931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:45.023470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:45.073397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:45.102639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9103ede-698d-4d55-b6e6-742136fc0ff0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:45.108575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:45.109181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:45.109450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:45.109715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:45.119102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:45.120690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:45.133396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1163/2317] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:54.992395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=9 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:55.126261 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=13 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:45:55.968785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefbe6-d1ff-4c79-acc3-5b14d517d31b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:55.969063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefbe6-d1ff-4c79-acc3-5b14d517d31b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:55.969334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefbe6-d1ff-4c79-acc3-5b14d517d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:55.989706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-45eefbe6-d1ff-4c79-acc3-5b14d517d31b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:55.990967 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45eefbe6-d1ff-4c79-acc3-5b14d517d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:55.998788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1155/2318] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:45:56.023495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:56.035083 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3903ed-0beb-4616-bca3-e7895db421d0 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:56.040539 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:56.041128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:56.041407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:56.041670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:56.050651 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:56.052231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:56.061934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1164/2319] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:45:58.898476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47224-0275-4b57-83c3-db28f1320d38 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:58.898999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47224-0275-4b57-83c3-db28f1320d38 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:58.899104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd47224-0275-4b57-83c3-db28f1320d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:58.918669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2bd47224-0275-4b57-83c3-db28f1320d38 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:45:58.919868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2bd47224-0275-4b57-83c3-db28f1320d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:58.980059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1156/2320] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:45:59.004353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:45:59.006118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:45:59.078311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6622b-85ee-4c3c-b5dc-4f64b2cac764 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:45:59.083547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:45:59.084169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:45:59.084447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:45:59.084718 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:45:59.094251 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:45:59.095962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:45:59.105797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1165/2321] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:04.579432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768029-66bc-4181-a65b-c411720bc1c4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.579950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768029-66bc-4181-a65b-c411720bc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.580043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768029-66bc-4181-a65b-c411720bc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.601786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-76768029-66bc-4181-a65b-c411720bc1c4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:04.603302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76768029-66bc-4181-a65b-c411720bc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:04.611620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1157/2322] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:04.718312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:04.730419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b5f2f-f955-4c8f-a08f-5ebeec93e28c service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:04.735938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:04.736531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:04.736807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:04.737571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:04.746207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:04.747786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:04.758242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1166/2323] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:06.953600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e2ef-a0f7-42f7-9a4b-2a3ca07a833a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:06.954439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e2ef-a0f7-42f7-9a4b-2a3ca07a833a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:06.954870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798e2ef-a0f7-42f7-9a4b-2a3ca07a833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:06.976176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b798e2ef-a0f7-42f7-9a4b-2a3ca07a833a None None] MFA Rules not processed for user `62e4da81d62c4350b81a6c72cd559462`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:06.977526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b798e2ef-a0f7-42f7-9a4b-2a3ca07a833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:07.036436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1158/2324] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:08.816084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:08.822973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:08.967512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711641c5-fa42-4104-a0c7-800096807f7c service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:08.977332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:08.980943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:08.981385 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:08.981805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:08.986033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:09.008254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:09.011854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:09.039054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1167/2325] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:09.691421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:09.691997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:09.691997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:09.734659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:09.736026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:09.746112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1159/2326] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:09.775516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:09.776922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:09.794607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9666d-cad1-45ed-b67b-b386d77d647c service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:09.800932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:09.801717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:09.802081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:09.802368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:09.811849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:09.813574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382009dd-5c1d-41fb-9903-cc45c1a226d5 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:09.823757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1168/2327] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:14.260284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:14.262617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.337002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7c62-751d-4a6b-bfc4-a53597f6e96f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:14.341498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:14.342502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:14.342984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:14.343457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:14.347140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:14.400538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:14.421441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:14.423163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:14.438265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1160/2328] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:17.052001 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecacff-5fb1-47f2-a2dd-e2547e957c06 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:17.053150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecacff-5fb1-47f2-a2dd-e2547e957c06 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:17.053761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecacff-5fb1-47f2-a2dd-e2547e957c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:17.099509 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d4ecacff-5fb1-47f2-a2dd-e2547e957c06 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:17.101273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d4ecacff-5fb1-47f2-a2dd-e2547e957c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:17.124291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1169/2329] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:17.165532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:17.185921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57cb8d-de4c-40e8-b855-f047aad86402 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:17.222691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:17.223778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:17.224342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:17.224846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:17.237223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:17.239142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:17.288185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1161/2330] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:22.570049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8d71-2c6f-4059-9685-8573a35e1e9e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.570049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8d71-2c6f-4059-9685-8573a35e1e9e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.570049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb8d71-2c6f-4059-9685-8573a35e1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.590090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c2fb8d71-2c6f-4059-9685-8573a35e1e9e None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:22.591314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c2fb8d71-2c6f-4059-9685-8573a35e1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:22.599634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1170/2331] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:22.633984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:22.645462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9a597-f843-4d15-a1a3-983acde7024f service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:22.651081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:22.651680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:22.651960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:22.652234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:22.661717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:22.663312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:22.672607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1162/2332] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:23.094403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de520-a3bf-4492-97d2-fb5973f7824e None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.094752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de520-a3bf-4492-97d2-fb5973f7824e None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.095088 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057de520-a3bf-4492-97d2-fb5973f7824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.115394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-057de520-a3bf-4492-97d2-fb5973f7824e None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:23.116798 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-057de520-a3bf-4492-97d2-fb5973f7824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:23.124526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1171/2333] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:23.138501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:23.151615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc97aa-2665-4447-bee4-2b06c2abd57d service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:23.157332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:23.157948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:23.158863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:23.159163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:23.169722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:23.171381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ecec8-91f5-4ba7-82ca-947b9fc484f4 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:23.180386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1163/2334] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:46:25.197516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d688-2e0f-4e33-9815-1356dac5d3d6 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.198132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d688-2e0f-4e33-9815-1356dac5d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.198247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598d688-2e0f-4e33-9815-1356dac5d3d6 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.199729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1172/2335] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:46:25.212792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.213288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.213386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.233320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] MFA Rules not processed for user `7e44512af18d47dcbd8f876b35dcb6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:25.234561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:25.245330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1164/2336] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:46:25.258152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598d688-2e0f-4e33-9815-1356dac5d3d6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.266253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.267693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:25.269791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:25.281850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598d688-2e0f-4e33-9815-1356dac5d3d6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.287036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a66a9-0bab-43e0-a944-5a7935fe7d0e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.288165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.288778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.289055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.289322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.292076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.292718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.293001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.293281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] PATH_INFO: `/v3/users/3e981040f515413f95d7114dab9a243f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.294465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e981040f515413f95d7114dab9a243f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.297254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.298230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.300347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.309983 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1173/2337] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:46:25.349129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e981040f515413f95d7114dab9a243f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.355964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e981040f515413f95d7114dab9a243f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.368292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e981040f515413f95d7114dab9a243f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.368903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e981040f515413f95d7114dab9a243f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.375930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09202940-0937-4001-85c5-0e544dbe77c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e981040f515413f95d7114dab9a243f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.382508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1165/2338] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:46:25 2022] DELETE /identity/v3/users/3e981040f515413f95d7114dab9a243f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:46:25.639465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.652196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e579-7470-4825-8dd9-79888d462f90 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.708816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.709438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.709713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.709984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] PATH_INFO: `/v3/projects/2244e8c17b0240ac8404cfbdcb9987e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.711127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2244e8c17b0240ac8404cfbdcb9987e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.713046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.758690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2244e8c17b0240ac8404cfbdcb9987e1', 'request_id': 'req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.764703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2244e8c17b0240ac8404cfbdcb9987e1', 'request_id': 'req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.772794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2244e8c17b0240ac8404cfbdcb9987e1', 'request_id': 'req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.782998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] The token cache is being invalidate because project 2244e8c17b0240ac8404cfbdcb9987e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:46:25.783282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.784467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b5cabe7-1d92-4317-a4f1-4711d3cc09e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:46:25.786061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1174/2339] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:46:25 2022] DELETE /identity/v3/projects/2244e8c17b0240ac8404cfbdcb9987e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:25.791089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.791374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.791650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.810765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:25.811956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:25.872382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1166/2340] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:25.880374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.880653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.880920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.900487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:25.901676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:25.910219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1175/2341] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:25.914523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.924194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d550a1-de22-4aa2-8929-ca7776c0b921 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.928766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.929591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.929717 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.929911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.930599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:46:25.930904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.932796 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:25.934113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:25.953680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1167/2342] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:46:25.958997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:25.968664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22639f-51ad-4d0c-9318-42f959ab0ae6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:25.974671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:25.975647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:25.975647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:25.975863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:25.976444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:25.978507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.012521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1176/2343] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:46:25 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:46:26.017504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.029526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252160-0240-484f-a774-21a8b7b4b170 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.111657 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.113303 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.113754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.114267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.115087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.117189 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.174937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1168/2344] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:46:26 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:46:26.179452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.195266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e29661-89e6-4b53-91b8-1327d0dbfd93 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.202657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.203312 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.203550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.203814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.204459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.206703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.217486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1177/2345] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:26.221574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.232568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca87-edbf-4cf0-a430-2eed8dfff8f4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.237254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.237948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.238284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.238563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.239202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.240798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6fc8-6984-4bdd-bf73-4f320d78ae3e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.252004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1169/2346] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:46:26.257485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.267611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63c0d-3ed5-48f6-beb6-aaf973690225 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.272751 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.273411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.273686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.273958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] PATH_INFO: `/v3/projects/e3dc498cf4b94b89a0ec2872d3643222/users/2003890990644cdfa241249d99e28d62/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.288243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dc498cf4b94b89a0ec2872d3643222, user_id=2003890990644cdfa241249d99e28d62, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.290916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.304462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1178/2347] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:46:26 2022] PUT /identity/v3/projects/e3dc498cf4b94b89a0ec2872d3643222/users/2003890990644cdfa241249d99e28d62/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:46:26.314552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421939-0b3f-4167-ac9b-0c2d67449625 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.315353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421939-0b3f-4167-ac9b-0c2d67449625 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.315626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c421939-0b3f-4167-ac9b-0c2d67449625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.347999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5c421939-0b3f-4167-ac9b-0c2d67449625 None None] MFA Rules not processed for user `2003890990644cdfa241249d99e28d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:26.349223 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5c421939-0b3f-4167-ac9b-0c2d67449625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:26.412396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1170/2348] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:46:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:26.423638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:26.426036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:26.444320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:26.484439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54de5a-66b8-41ce-9c7a-05680ece641a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:26.488264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:26.488859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:26.489136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:26.489406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:26.497720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:26.499174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1476b85-3d73-4447-b08f-75d9307c3eab service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:26.508593 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1179/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:46:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:46:36.409401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:36.504249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=19 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:46:54.013274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:54.013871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:54.013871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:54.033080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] MFA Rules not processed for user `a059bfaf2241471eab5753144129cb68`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:54.034335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:54.092350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1171/2350] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:56.852957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:56.853512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:56.853512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:56.879660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:46:56.882242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:56.987285 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1180/2351] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:46:57.007963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:46:57.009738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:46:57.100681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055a89-a9e8-4d34-ae45-e556dd1fee9c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:46:57.105881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:46:57.106566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:46:57.106855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:46:57.107121 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:46:57.117045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:46:57.118720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a881f-8e40-411c-96b1-14342931ef32 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:46:57.132131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1172/2352] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:46:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:47:06.975845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=25 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:07.127179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=57 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:13.593329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.658654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f18df-4dd5-4a3a-8970-806257d6ede3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.663241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.663872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.664151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.664423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] PATH_INFO: `/v3/users/2003890990644cdfa241249d99e28d62` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.665560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2003890990644cdfa241249d99e28d62)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:13.667684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:13.716938 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2003890990644cdfa241249d99e28d62'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:13.729883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2003890990644cdfa241249d99e28d62'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:13.737049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2003890990644cdfa241249d99e28d62'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:13.737774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2003890990644cdfa241249d99e28d62'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:13.746382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2003890990644cdfa241249d99e28d62'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:13.753419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1181/2353] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:13 2022] DELETE /identity/v3/users/2003890990644cdfa241249d99e28d62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:13.758414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.759260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.759420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:13.779583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:13.780810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:13.848053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1173/2354] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:13.860908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:13.864325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:13.974788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f89f4-8b7c-4219-87bc-7b0e970bccee admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:13.983264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:13.984236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:13.984689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:13.985712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.007200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.008994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921596-a5d7-405a-b08d-5ca0f989cc0e service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.021910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1182/2355] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:14.375864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.378211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:14.396816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46ea4-cd32-4e55-bc38-15d9e715d28d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.401907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.402689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.403081 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.403480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] PATH_INFO: `/v3/projects/e3dc498cf4b94b89a0ec2872d3643222` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.404771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dc498cf4b94b89a0ec2872d3643222)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.407455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.480375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dc498cf4b94b89a0ec2872d3643222', 'request_id': 'req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:14.494879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dc498cf4b94b89a0ec2872d3643222', 'request_id': 'req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:14.505467 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dc498cf4b94b89a0ec2872d3643222', 'request_id': 'req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:14.520112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] The token cache is being invalidate because project e3dc498cf4b94b89a0ec2872d3643222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:14.520487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:14.521239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ef3c4434-3fa9-4bfd-abe4-aa8420d9b8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:14.523176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1174/2356] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:14 2022] DELETE /identity/v3/projects/e3dc498cf4b94b89a0ec2872d3643222 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:14.528712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.529055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.529439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.551616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:14.552972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:14.575327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:14.642238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1183/2357] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:14.710482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.710882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.711059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.733817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:14.735085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:14.747393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1175/2358] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:14.748941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.760843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0fd53-6a28-4df0-ada3-1e6ea37c7614 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.770103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.770876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.771254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.771625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.772485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:47:14.772876 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.774650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.794770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1184/2359] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:47:14.796359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.806608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9314f05-558a-43b0-9f74-c52faa81d059 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:14.812305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:14.813844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:14.814422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:14.814961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:14.815834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:14.819073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:14.867859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1176/2360] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:47:14 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:14.871892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:14.885585 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2b63f-6136-4b01-b6f9-ae1374b8ff98 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.035654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.036628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.036907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.037174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.037809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.039807 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.074107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1185/2361] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:47:14 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:47:15.078165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.091558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d8651-a556-4118-9595-5472ceb8c0ef admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.097532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.098666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.099016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.099396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.100070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.101678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.114245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1177/2362] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:47:15.118797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.136833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731440-a610-44ed-961a-d8287f8c2cc4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.147275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.148424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.148931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.149415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.150653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.153859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edf8f4-9f27-441a-b621-2db04766006b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.168163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1186/2363] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:47:15.173382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.184531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f341dc9-b35a-496e-a1e5-c2da0108afdd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.194048 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.195037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.195575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.196058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] PATH_INFO: `/v3/projects/3000060e12c14ca590864b092b61475e/users/68299979898848c68958b1ad2a7c775a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.221017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.221455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.222013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.222417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3000060e12c14ca590864b092b61475e, user_id=68299979898848c68958b1ad2a7c775a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.225186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6081a-9e03-45c0-bee2-39022aa58a93 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.250031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:15.251796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.252013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1178/2364] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:47:15 2022] PUT /identity/v3/projects/3000060e12c14ca590864b092b61475e/users/68299979898848c68958b1ad2a7c775a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:15.262455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.262753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.263033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.293641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] MFA Rules not processed for user `68299979898848c68958b1ad2a7c775a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:15.294910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.304361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:15.327961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1187/2365] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:15.355006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.356379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.370554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1179/2366] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:15.383424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:15.384888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:15.390793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:15.444588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba1cc8-9d8f-4a39-baf6-a16fbe146989 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.452942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.454485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.454931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.455362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.459245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d5d4-6390-4943-8a6c-4a8e153e7ca6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:15.465034 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:15.465970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:15.466327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:15.466753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:15.470538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.473524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.483872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:15.486661 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60544e-3993-45a5-90aa-450ee74e6a92 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:15.490530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1188/2367] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:15.498803 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1180/2368] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:18.162992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.173521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d40d8e-3119-4664-9fa1-adbdc6744280 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.178246 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.178878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.179153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.179446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] PATH_INFO: `/v3/users/68299979898848c68958b1ad2a7c775a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.180580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68299979898848c68958b1ad2a7c775a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.182808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.240793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68299979898848c68958b1ad2a7c775a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.255420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68299979898848c68958b1ad2a7c775a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.262569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68299979898848c68958b1ad2a7c775a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.263320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68299979898848c68958b1ad2a7c775a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.272171 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68299979898848c68958b1ad2a7c775a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.278742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1189/2369] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:47:18 2022] DELETE /identity/v3/users/68299979898848c68958b1ad2a7c775a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:47:18.284091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.284849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.285015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.305109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:18.306377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.367109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1181/2370] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:18.377180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.378812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.437978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659deb2-e6bb-4915-9187-be2265b4f8a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.441671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.442304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.442579 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.442842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.452296 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.454259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296c877-e9ef-484f-8f2b-8c11653e35a8 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.464713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1190/2371] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:18.779374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:18.781162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:18.796320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc4cb2-141b-4951-8e00-ec060aee9ec8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:18.803042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:18.803711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:18.804227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:18.804513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] PATH_INFO: `/v3/projects/3000060e12c14ca590864b092b61475e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:18.805705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3000060e12c14ca590864b092b61475e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:18.807857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:18.868984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:18.871216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3000060e12c14ca590864b092b61475e', 'request_id': 'req-4d6468eb-fdd5-4654-9668-5efcebdffc97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.881108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3000060e12c14ca590864b092b61475e', 'request_id': 'req-4d6468eb-fdd5-4654-9668-5efcebdffc97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.888997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3000060e12c14ca590864b092b61475e', 'request_id': 'req-4d6468eb-fdd5-4654-9668-5efcebdffc97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.901371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] The token cache is being invalidate because project 3000060e12c14ca590864b092b61475e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:47:18.901588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.902274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4d6468eb-fdd5-4654-9668-5efcebdffc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:47:18.903790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1182/2372] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:47:18 2022] DELETE /identity/v3/projects/3000060e12c14ca590864b092b61475e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:47:20.591619 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.592286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.592808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.596235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1191/2373] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:47:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:47:20.604536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f6cc-d028-437c-8637-cba890c6bf57 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.605135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f6cc-d028-437c-8637-cba890c6bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.605451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3f6cc-d028-437c-8637-cba890c6bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.630829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2af3f6cc-d028-437c-8637-cba890c6bf57 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:20.632322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2af3f6cc-d028-437c-8637-cba890c6bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:20.716026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1183/2374] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:20.728122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:20.730037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:20.768359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:20.810130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f84c1-69a1-4ada-991a-e3ed51487212 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:20.814259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:20.814874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.815147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.815409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.826895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:20.828405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d52a93-f16f-487d-b40d-7fcafc24ed00 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:20.840627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1192/2375] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:20.929666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.930005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.930367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.931924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1184/2376] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:47:20.941967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f235918-eb8f-4d59-b505-9ef89e9d3cc4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:20.942387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f235918-eb8f-4d59-b505-9ef89e9d3cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:20.942858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f235918-eb8f-4d59-b505-9ef89e9d3cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:20.963716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-2f235918-eb8f-4d59-b505-9ef89e9d3cc4 None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:20.964949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2f235918-eb8f-4d59-b505-9ef89e9d3cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.020433 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1193/2377] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:21.033389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.035135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.049378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d443fc-089a-48e6-aca2-245fd15bb3a6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.053029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.053647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.053989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.054231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.062184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.063618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428827b0-69be-48fc-9f35-861e03f2a6a0 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.072090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1185/2378] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:21.159870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713229e6-cdf4-4789-aa85-fb2997fc7c9a None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.160154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713229e6-cdf4-4789-aa85-fb2997fc7c9a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.160432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713229e6-cdf4-4789-aa85-fb2997fc7c9a None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.161799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1194/2379] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 10:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 10:47:21.168292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c2ac-1c90-4c01-a611-19101ee80f85 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.168568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c2ac-1c90-4c01-a611-19101ee80f85 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.168843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c2ac-1c90-4c01-a611-19101ee80f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.189424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f599c2ac-1c90-4c01-a611-19101ee80f85 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:21.190678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f599c2ac-1c90-4c01-a611-19101ee80f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:21.200046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1186/2380] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:21.211703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713229e6-cdf4-4789-aa85-fb2997fc7c9a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:21.223672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713229e6-cdf4-4789-aa85-fb2997fc7c9a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:21.227594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:21.228206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:21.228583 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:21.228734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:21.239862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:21.241302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:21.256052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1195/2381] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:22.700926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92c2e-eeba-4300-99a9-32e71a6cb4ee None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.701526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92c2e-eeba-4300-99a9-32e71a6cb4ee None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.701873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92c2e-eeba-4300-99a9-32e71a6cb4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.731998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3ed92c2e-eeba-4300-99a9-32e71a6cb4ee None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:22.733296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3ed92c2e-eeba-4300-99a9-32e71a6cb4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.810290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1187/2382] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:47:22.840081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:22.842237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:22.865000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b60e40-e321-47a5-b9f8-70d34e006d73 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:22.870823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:22.871446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:22.871719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:22.871981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:22.881370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:22.882989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:22.893258 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1196/2383] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:26.759568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a095d-e7c4-417b-89d3-4985ed14fa4b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.760128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a095d-e7c4-417b-89d3-4985ed14fa4b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.760128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a095d-e7c4-417b-89d3-4985ed14fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.782600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b24a095d-e7c4-417b-89d3-4985ed14fa4b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:26.783828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b24a095d-e7c4-417b-89d3-4985ed14fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.792074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1188/2384] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.822328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.823969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.842573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69945ae-7514-4f11-a414-5bdaf8e6fb57 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:26.852811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:26.853755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.854237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.854694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.862220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575cc06-238c-4745-9771-dbfb8cfe866c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:26.862686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575cc06-238c-4745-9771-dbfb8cfe866c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:26.863131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575cc06-238c-4745-9771-dbfb8cfe866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:26.869421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:26.872241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:26.888565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1197/2385] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:47:26.891895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9575cc06-238c-4745-9771-dbfb8cfe866c None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:26.893227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9575cc06-238c-4745-9771-dbfb8cfe866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:26.937444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:26.962620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1189/2386] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:26.978985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:26.980628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:27.084687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f1e3-a524-46e0-92e1-4005dcf4d4a0 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:27.095206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:27.096701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:27.097193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:27.097658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:27.114675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:27.117650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:27.136121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1198/2387] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:47:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:47:36.951007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:37.131800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:47:54.723790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8ff0-ed64-40f9-a495-dc1617d0bee0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:54.724373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8ff0-ed64-40f9-a495-dc1617d0bee0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:54.724373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8ff0-ed64-40f9-a495-dc1617d0bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:54.746856 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-541c8ff0-ed64-40f9-a495-dc1617d0bee0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:54.748351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-541c8ff0-ed64-40f9-a495-dc1617d0bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:54.756928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1190/2388] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:54.789685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:54.802881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d6d43-16c4-4bba-98d9-f5728071fcea service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:54.808914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:54.809515 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:54.809788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:54.810055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:54.818769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:54.820341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:54.829851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1199/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:47:56.656998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e984-2148-4607-892d-d4bd3c6050da None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:56.657478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e984-2148-4607-892d-d4bd3c6050da None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:56.657578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e984-2148-4607-892d-d4bd3c6050da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:56.676789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ba67e984-2148-4607-892d-d4bd3c6050da None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:47:56.677980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba67e984-2148-4607-892d-d4bd3c6050da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:47:56.685255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1191/2390] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:47:56.697416 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:47:56.709193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c505a6-6ec5-4b1b-8a62-c1b5ff94e19c service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:47:56.714048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:47:56.714655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:47:56.714934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:47:56.715200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:47:56.724097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:47:56.725671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:47:56.733837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1200/2391] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:48:02.019931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.020425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.020425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.039401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:48:02.040600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:02.049208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1192/2392] 10.222.0.60 () {58 vars in 1016 bytes} [Wed Aug 24 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:48:02.080359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:02.092645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dadaa-f8d3-47b0-b889-3a735f93e798 service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:02.098444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:02.099054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:02.099332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:02.099607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:02.108609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:02.110216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:02.119833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1201/2393] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:07.163758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:07.165152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:07.223705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2193-8ec4-41d6-9b15-d8b8ed7242d0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:07.228274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:07.228893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:07.229170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:07.229441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:07.231219 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:07.245741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:07.247145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:07.258676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1193/2394] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:12.115695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=18 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:12.271817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:12.273415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:12.295459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03cec-ebe5-4d67-8ea3-edeaecfe42b9 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:12.302166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:12.303181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:12.303662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:12.304201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:12.306943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:12.332278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:12.335489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:12.356357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1202/2395] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:48:17.253680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=35 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:22.348725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:32.820085 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:32.831077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a949dd0-5506-4869-9ebd-0b9c817f431f service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:32.839596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:32.840536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:32.840731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:32.841700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:32.844157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:32.859783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:32.862756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:32.884080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1194/2396] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:48:41.164013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.167912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:41.194928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e622ed-806e-41ae-a3ef-38519ac05f22 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.203947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.205002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.205478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.205946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] PATH_INFO: `/v3/users/a059bfaf2241471eab5753144129cb68` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.207900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a059bfaf2241471eab5753144129cb68)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.211532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.292119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a059bfaf2241471eab5753144129cb68'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.310733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a059bfaf2241471eab5753144129cb68'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.319007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a059bfaf2241471eab5753144129cb68'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.319800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a059bfaf2241471eab5753144129cb68'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.329177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a059bfaf2241471eab5753144129cb68'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.337072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1203/2397] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:48:41 2022] DELETE /identity/v3/users/a059bfaf2241471eab5753144129cb68 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:41.526059 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:41.547356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121bd90-d2fa-4617-9071-1bba08b6f050 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:41.642000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:41.642908 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:41.643383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:41.643852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] PATH_INFO: `/v3/projects/a469c32cb44e47f69ac362311e1719ec` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:41.645244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a469c32cb44e47f69ac362311e1719ec)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:41.648000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:41.708371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a469c32cb44e47f69ac362311e1719ec', 'request_id': 'req-a3e0e5d2-450d-4d17-be01-32c356a56522'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.716607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a469c32cb44e47f69ac362311e1719ec', 'request_id': 'req-a3e0e5d2-450d-4d17-be01-32c356a56522'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.727466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a469c32cb44e47f69ac362311e1719ec', 'request_id': 'req-a3e0e5d2-450d-4d17-be01-32c356a56522'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.746776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] The token cache is being invalidate because project a469c32cb44e47f69ac362311e1719ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:48:41.747292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.748344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a3e0e5d2-450d-4d17-be01-32c356a56522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:48:41.761274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1195/2398] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:48:41 2022] DELETE /identity/v3/projects/a469c32cb44e47f69ac362311e1719ec => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:48:51.332504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:51.740472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:48:53.987322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:48:53.988993 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:54.073480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d87174-5deb-49e5-afd6-e610e088026f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:48:54.147732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:48:54.148415 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:48:54.148736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:48:54.149052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:48:54.157905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:48:54.224449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:48:54.227212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:48:54.238159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1204/2399] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:48:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:49:04.233551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:19.361138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:19.361817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:19.361817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:19.382927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] MFA Rules not processed for user `62e4da81d62c4350b81a6c72cd559462`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:19.384288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:19.392382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1196/2400] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:49:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:49:20.945381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:20.946979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:20.961984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa88c-2663-45f3-a223-0175d09f7085 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:20.969216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:20.970026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:20.970493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:20.970921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:20.973237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:21.046809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:21.048445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa67491-5d0d-40e4-94bb-888eb178868c service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:21.059514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1205/2401] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:49:26.303821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:26.306936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:26.340348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778377e-8485-43d2-8ed9-3eb4d6e74775 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:26.346751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:26.347516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:26.347973 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:26.348342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:26.350445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:26.365569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:26.367488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:26.381737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1197/2402] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:31.054918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=28 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:34.803638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:34.804272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:34.804272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:34.825095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] MFA Rules not processed for user `ba9ad96c6092431abc7b474ac7a26cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:49:34.826382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:34.834081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1206/2403] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:49:35.226172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:35.227937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:35.288296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b4ee-9d9e-4fb8-8087-fbc3bc85e822 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:35.292627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:35.293308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:35.293631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:35.293961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:35.295811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:35.306810 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:35.308295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:35.319171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1198/2404] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:36.699913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:36.702020 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:36.801028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ca683-d6b8-4cac-ad3b-849d117f6213 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:36.809987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:36.811117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:36.811601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:36.812068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:36.815479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:36.836014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:36.840065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:36.856292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1207/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:45.313264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=35 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:46.850998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=35 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:49:49.347064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:49:49.364375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501046e-c7ed-4760-a632-58196fbb4045 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:49:49.374557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:49:49.376018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:49:49.376699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:49:49.377202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:49:49.380428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:49:49.402571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:49:49.405173 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:49:49.424203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1199/2406] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:49:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:49:59.417469 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:00.309956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:00.331900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d3a7-0779-4d15-aef6-691db75967bb service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:00.341668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:00.342490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:00.342901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:00.343401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:00.346386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:00.424769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:00.426728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:00.436878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1208/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:10.432360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=28 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:12.104443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:12.116457 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e3ab-1d81-42e0-b50c-f342b5cbaec5 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:12.123163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:12.123788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:12.124071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:12.124350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:12.126230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:12.191756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:12.193359 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85f629-c541-4062-841e-35f2ecb162be service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:12.204000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1200/2408] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:12.743120 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:12.765305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb043-115f-43a1-91b7-cad38e6e4c1d service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:12.778605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:12.782550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:12.783046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:12.783744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:12.787073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:12.815950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:12.821617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:12.866007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1209/2409] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:22.199324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=28 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:22.850840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=6 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:23.345197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:23.345731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:23.345850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:23.369307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:50:23.370574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:23.428411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1201/2410] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:50:23.476700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:23.478250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:23.549128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97ff5-c253-43dc-b7a7-757bfe31ade3 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:23.554678 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:23.555335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:23.555654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:23.555963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:23.564556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:23.566175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:23.574933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1210/2411] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:50:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:50:23.933439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:23.934857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:23.949581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93094f1-8204-436f-93f7-1f23d10e8f50 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:23.953437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:23.954058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:23.954364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:23.954636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:23.956489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:24.029654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:24.031402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:24.042518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1202/2412] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:50:27.806031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:27.818843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb10d76-c5a9-4695-85a7-2731e2237aaf service swift] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:27.826733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:27.827768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:27.828061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:27.828372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:27.830318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:27.849461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:27.851939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:27.868428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1211/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:50:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:50:31.853125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:31.855742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:31.869129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b483a-654d-4b90-9420-5e238af78ccd service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:31.874377 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:31.875042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:31.875315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:31.875591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] PATH_INFO: `/v3/users/6d498f9f15a84f4489c2c3f2eab74781` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:31.876759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d498f9f15a84f4489c2c3f2eab74781)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:31.878708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:31.935206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d498f9f15a84f4489c2c3f2eab74781'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:31.942460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d498f9f15a84f4489c2c3f2eab74781'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:31.957592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d498f9f15a84f4489c2c3f2eab74781'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:31.958361 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d498f9f15a84f4489c2c3f2eab74781'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:31.968091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d498f9f15a84f4489c2c3f2eab74781'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:31.975136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1203/2414] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:31 2022] DELETE /identity/v3/users/6d498f9f15a84f4489c2c3f2eab74781 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:50:32.171948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:32.187414 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf387e-1e46-4247-a4a7-924b31684867 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:32.261620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:32.261620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:32.261620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:32.261994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] PATH_INFO: `/v3/projects/52a85cd06a53421f82e54b2319ad91af` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:32.262942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a85cd06a53421f82e54b2319ad91af)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:32.265157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:32.344458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a85cd06a53421f82e54b2319ad91af', 'request_id': 'req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.351587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a85cd06a53421f82e54b2319ad91af', 'request_id': 'req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.361090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a85cd06a53421f82e54b2319ad91af', 'request_id': 'req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.373710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] The token cache is being invalidate because project 52a85cd06a53421f82e54b2319ad91af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:32.374623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.375411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.377615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1212/2415] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:32 2022] DELETE /identity/v3/projects/52a85cd06a53421f82e54b2319ad91af => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:50:32.383284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:32.385151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:32.401313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b2a6b-e581-49fd-b4a3-36b39622ee52 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:32.409761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:32.476597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:32.477233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:32.477517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:32.477792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] PATH_INFO: `/v3/users/e6c7519d49f44620853bce57ec87d7eb` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:32.479018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c7519d49f44620853bce57ec87d7eb)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:32.480964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:32.533632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c7519d49f44620853bce57ec87d7eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.540773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c7519d49f44620853bce57ec87d7eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.553307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c7519d49f44620853bce57ec87d7eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.554041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c7519d49f44620853bce57ec87d7eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.562574 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c7519d49f44620853bce57ec87d7eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.569357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1204/2416] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:50:32 2022] DELETE /identity/v3/users/e6c7519d49f44620853bce57ec87d7eb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:50:32.781043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:50:32.782655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:50:32.798423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034a515-6f09-4e9d-8fdc-6935f7f44a5c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:50:32.803719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:32.872281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:50:32.872925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:50:32.873200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:50:32.873470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] PATH_INFO: `/v3/projects/a049302ab3604865893306a2095c365d` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:50:32.874684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a049302ab3604865893306a2095c365d)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:50:32.876613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:50:32.928931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a049302ab3604865893306a2095c365d', 'request_id': 'req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.935830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a049302ab3604865893306a2095c365d', 'request_id': 'req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.944863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a049302ab3604865893306a2095c365d', 'request_id': 'req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.957144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] The token cache is being invalidate because project a049302ab3604865893306a2095c365d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:50:32.957435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.958172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:50:32.959790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1213/2417] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:50:32 2022] DELETE /identity/v3/projects/a049302ab3604865893306a2095c365d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:50:42.564952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:50:42.953730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:00.024532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:00.026005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.117382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c658-6d96-46ce-a16f-26d4f18c548a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:00.167688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:00.168370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:00.168686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:00.169033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:00.170924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:00.281263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:00.282744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:00.287210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:00.304995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1205/2418] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:03.527738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:03.529359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:03.617133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6be6e-bb66-4774-a2b5-aae28f988b1e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:03.622147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:03.622782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:03.623061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:03.623332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] PATH_INFO: `/v3/users/62e4da81d62c4350b81a6c72cd559462` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:03.624495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e4da81d62c4350b81a6c72cd559462)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:03.626704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:03.692994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e4da81d62c4350b81a6c72cd559462'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:03.704642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e4da81d62c4350b81a6c72cd559462'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:03.711444 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e4da81d62c4350b81a6c72cd559462'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:03.712133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e4da81d62c4350b81a6c72cd559462'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:03.719488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5fdd8e84-6660-468d-88d1-8bda5ba494b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e4da81d62c4350b81a6c72cd559462'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:03.725384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1214/2419] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:51:03 2022] DELETE /identity/v3/users/62e4da81d62c4350b81a6c72cd559462 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:03.904276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:03.914956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6ed35-0afe-47b6-919b-23e1fbea3f1c service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:03.971867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:03.972506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:03.972789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:03.973063 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] PATH_INFO: `/v3/projects/cab2f36b8f9344a5b393d94aa1c6069c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:03.974721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab2f36b8f9344a5b393d94aa1c6069c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:03.976653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.024280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab2f36b8f9344a5b393d94aa1c6069c', 'request_id': 'req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:04.030429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab2f36b8f9344a5b393d94aa1c6069c', 'request_id': 'req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:04.038782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab2f36b8f9344a5b393d94aa1c6069c', 'request_id': 'req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:04.049101 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] The token cache is being invalidate because project cab2f36b8f9344a5b393d94aa1c6069c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:51:04.049398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:04.050030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac51ad6b-3067-4a36-b03b-2cf1c10057eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:51:04.051507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1206/2420] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:51:03 2022] DELETE /identity/v3/projects/cab2f36b8f9344a5b393d94aa1c6069c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:04.057092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.057381 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.057650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.113658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:04.115445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:04.159590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:04.177062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1215/2421] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:04.185131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.185415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.185694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.205313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:04.206539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:04.214896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1207/2422] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:04.219409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.229081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6f1d4-ab5f-46d6-a814-42b938c0c75a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.233569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.234187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.234463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.234728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.235363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:51:04.235661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.237247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.249031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1216/2423] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:51:04.253475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.263325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fbd55-4209-44ee-be64-a8b369dbe2da None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.269002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.269837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.270892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.271205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.271859 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.274135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.303728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1208/2424] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:51:04.308167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.319874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be135e2-b118-4060-8032-0dd578f8c1e2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.382403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.383177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.383453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.383824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.384355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.386299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.409464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1217/2425] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:51:04.414525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.425187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86841897-01f4-4057-82fe-4fc89fbec53f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.430004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.430649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.430931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.431209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.431883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.433507 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.444199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1209/2426] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:04.448276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.458965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7c6dd-9371-4ddf-9fe1-40a7eb6d4429 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.463881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.464610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.464890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.465161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.465809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.467475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb21477-57c1-4dd1-aa1c-870e28ec69fa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.480400 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1218/2427] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:51:04.484667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.494793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6364-bf29-4c57-ab91-88515e49ff11 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.499743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.500398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.500683 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.500962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] PATH_INFO: `/v3/projects/3aa206130c9e4f2496da3a5ee2ece4cd/users/e2350f11b09846d48385a08eb29a95e6/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.517136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa206130c9e4f2496da3a5ee2ece4cd, user_id=e2350f11b09846d48385a08eb29a95e6, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.519901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.534195 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1210/2428] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:51:04 2022] PUT /identity/v3/projects/3aa206130c9e4f2496da3a5ee2ece4cd/users/e2350f11b09846d48385a08eb29a95e6/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:51:04.539849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b38a-5709-46c5-ba26-03a507853a89 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.540322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b38a-5709-46c5-ba26-03a507853a89 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.540440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b38a-5709-46c5-ba26-03a507853a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.559239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-20d9b38a-5709-46c5-ba26-03a507853a89 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:04.560362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-20d9b38a-5709-46c5-ba26-03a507853a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:04.620701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1219/2429] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:04.630508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:04.632242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:04.651090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:04.690041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e81ed-881a-4dbf-8c9a-da87a9408b46 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:04.694229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:04.694830 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:04.695135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:04.695406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:04.704230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:04.705644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:04.715419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1211/2430] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:09.032899 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c46e-bb1f-4f63-a59e-619c6643f66b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.033560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c46e-bb1f-4f63-a59e-619c6643f66b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.033560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c46e-bb1f-4f63-a59e-619c6643f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.069582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0798c46e-bb1f-4f63-a59e-619c6643f66b None None] MFA Rules not processed for user `e2350f11b09846d48385a08eb29a95e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:09.070891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0798c46e-bb1f-4f63-a59e-619c6643f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.121979 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:09.148592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1220/2431] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:09.166628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:09.169201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:09.282748 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514ce2d-2fc1-4084-bd96-511e343e6596 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:09.288402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:09.289031 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:09.289310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:09.289582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:09.298158 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:09.299790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:09.309677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1212/2432] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:51:10.627536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.628042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.628161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:10.647662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] MFA Rules not processed for user `e2350f11b09846d48385a08eb29a95e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:10.648875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:10.656116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1221/2433] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:10.978468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:10.980058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:10.992755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4582aa-ae62-432f-b6ba-e00d9b17adce service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:10.996953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:10.997564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:10.997844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:10.998171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:11.000038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:11.010847 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:11.012302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed37b4-ab25-439b-a392-7c6790e7954d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:11.021374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1213/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:11.897380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:11.900109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:11.998557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710947a4-7b14-44ef-8893-4c33a43ff7c8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:12.003569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:12.004229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:12.004470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:12.004738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:12.006741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:12.019341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:12.021463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bccf9-25f6-4f0b-a766-9ad2e656256e service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:12.032009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1222/2435] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:51:21.017079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=71 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:22.027714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=51 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:51:50.444620 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:50.445150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:50.445150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:50.464310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] MFA Rules not processed for user `41b9798ed3904162b6dfd473f68fca49`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:50.465495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:50.521646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1214/2436] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:51:59.114945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461be7-967d-4659-9f6c-ef8c122a4780 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:59.115447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461be7-967d-4659-9f6c-ef8c122a4780 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:59.115548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461be7-967d-4659-9f6c-ef8c122a4780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:59.146308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e9461be7-967d-4659-9f6c-ef8c122a4780 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:51:59.147519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e9461be7-967d-4659-9f6c-ef8c122a4780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:59.203134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1223/2437] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:51:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:51:59.250432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:51:59.251862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:51:59.321396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21475b47-b8c3-4f55-907f-75e5d2cb668d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:51:59.326342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:51:59.326952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:51:59.327230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:51:59.327503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:51:59.335997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:51:59.337564 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:51:59.347596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1215/2438] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:52:09.196361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=29 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:09.342520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=57 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:16.414486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5257aa-fe0b-4794-ac09-5e94aff74d9d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:16.415033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5257aa-fe0b-4794-ac09-5e94aff74d9d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:16.415033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5257aa-fe0b-4794-ac09-5e94aff74d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:16.435235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-df5257aa-fe0b-4794-ac09-5e94aff74d9d None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:16.436552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-df5257aa-fe0b-4794-ac09-5e94aff74d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:16.444703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1224/2439] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:16.461373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:16.473688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec846-4a6b-4c6d-936e-c2f12b873bb1 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:16.479053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:16.479691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:16.479971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:16.480248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:16.489306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:16.490964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:16.500252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1216/2440] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:52:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:52:26.429462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:26.496567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:38.869492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ff41-7a82-40f1-af0d-c5dd4a48ba8a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:38.870332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ff41-7a82-40f1-af0d-c5dd4a48ba8a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:38.870332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ff41-7a82-40f1-af0d-c5dd4a48ba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:38.891597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e907ff41-7a82-40f1-af0d-c5dd4a48ba8a None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:52:38.892831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e907ff41-7a82-40f1-af0d-c5dd4a48ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:52:38.900061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1225/2441] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:52:38.918500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:52:38.929380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66c2b8-2105-4a94-9977-00f997b76bc8 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:52:38.934669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:52:38.935278 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:52:38.935550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:52:38.935818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:52:38.945080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:52:38.946793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:52:38.957474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1217/2442] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:52:48.884929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:52:48.952400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:12.359029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.359984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.359984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.381841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] MFA Rules not processed for user `e2350f11b09846d48385a08eb29a95e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:53:12.383151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:12.391648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1226/2443] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:53:12.436602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:12.438279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:12.500590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679dfe2-49b8-4d64-b6cf-1e2565b6d8e6 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:12.504646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:12.505249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:12.505541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:12.505851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:12.507799 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:12.524763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:12.526559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:12.541946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1218/2444] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:13.216156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:53:13.241776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d46503-0d77-48f2-a5e9-d1ff44aad627 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:53:13.247728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:53:13.248668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:53:13.249024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:53:13.249372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:53:13.251781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:53:13.268122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:53:13.269887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:53:13.284594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1227/2445] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:53:22.536030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=26 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:53:23.278210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=13 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:08.943005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:08.957140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23af9-7dfc-4956-bd81-3be6a1ffff40 service glance] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:08.964462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:08.965718 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:08.967754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:08.968429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:08.975876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:09.057843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:09.064598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:09.100971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1219/2446] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:11.593914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:11.602595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291793b8-8262-4be5-8df4-109dc99891c5 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:11.606769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:11.607024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:11.607302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:11.607623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:11.609496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:11.621933 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:11.623403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:11.633733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1228/2447] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:14.533624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:14.549047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d820f-41d3-445a-9be5-384d836ea10c service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:14.557892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:14.559288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:14.559483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:14.559971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:14.572832 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:14.608098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:14.610266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:14.622755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1220/2448] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:15.014427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.037641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e0927-8e69-4734-99a1-73f22a2a7c57 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.056613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:15.057732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.058307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.058802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.061319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:15.082380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.085100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:15.121883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:15.123796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:15.125937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b2fb-8947-4d67-8add-503c748d0d70 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.133699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:15.134387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.134685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.134940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] PATH_INFO: `/v3/users/ba9ad96c6092431abc7b474ac7a26cc4` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.136889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1229/2449] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:15.153578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9ad96c6092431abc7b474ac7a26cc4)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:15.155839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:15.223140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9ad96c6092431abc7b474ac7a26cc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.230279 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9ad96c6092431abc7b474ac7a26cc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.243528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9ad96c6092431abc7b474ac7a26cc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.244430 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9ad96c6092431abc7b474ac7a26cc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.255414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fb4fe1fe-9a7c-4ad9-a82c-b5515374fc58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9ad96c6092431abc7b474ac7a26cc4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.262821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1221/2450] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:15 2022] DELETE /identity/v3/users/ba9ad96c6092431abc7b474ac7a26cc4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:15.457320 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.474815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d73a-e3f0-4da3-b232-9b612f8f5212 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.544347 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:15.544987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.545264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.545516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] PATH_INFO: `/v3/projects/e140b734ec2a4f6598bbdd2ef70584b4` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.557349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e140b734ec2a4f6598bbdd2ef70584b4)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:15.559334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:15.612632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e140b734ec2a4f6598bbdd2ef70584b4', 'request_id': 'req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.622522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e140b734ec2a4f6598bbdd2ef70584b4', 'request_id': 'req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.632205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e140b734ec2a4f6598bbdd2ef70584b4', 'request_id': 'req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.645361 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] The token cache is being invalidate because project e140b734ec2a4f6598bbdd2ef70584b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:15.645643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.646337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-eb8983ac-0a2a-40d8-84f3-a837cc5e8e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:15.647831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1230/2451] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:15 2022] DELETE /identity/v3/projects/e140b734ec2a4f6598bbdd2ef70584b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:15.652878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.653751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.654025 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.674409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:15.675768 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:15.740004 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1222/2452] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:15.748529 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.748805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.749058 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.777263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:15.778532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:15.786972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1231/2453] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:15.791270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.802165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03907fab-3b9d-4a93-9c90-e4ea5ad30292 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.809921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:15.810567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.810854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.811124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.812050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:15.812354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:15.814595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:15.826785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1223/2454] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:54:15.831306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.841772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112022-4301-4530-9b75-3d5ad6be7731 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.849214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:15.849840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:15.850146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:15.850418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:15.851096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:15.853489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:15.894880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1232/2455] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:15 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:15.899211 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:15.914660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68828c5-3a35-414b-b293-3cb70525f73e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:15.925626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:16.002352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.003535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.003535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.003535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.004215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.006274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.033878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1224/2456] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:15 2022] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:16.038660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.051574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55bf8c-1237-4d0b-8ba7-cd6b9b238b8e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.057107 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.057927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.058291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.058653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.059388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.061085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.079084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1233/2457] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:16.083638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.097071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520ed38-1d6b-49d0-aeec-fbdc17e5eb2c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.102349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.102997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.103286 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.103565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.104243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.105905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9fd3-4ca8-4744-bdab-c05e0962a332 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.119334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1225/2458] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:16.124514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.136670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd568f-ff2f-4905-80c7-804839cd5fdb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.147652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.148330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.148611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.149310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] PATH_INFO: `/v3/projects/1fc39b7bdf5e412a895a7ad87c363c6e/users/c42ff4cd555443e59e99e1fbaca22118/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.152765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:16.176443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc39b7bdf5e412a895a7ad87c363c6e, user_id=c42ff4cd555443e59e99e1fbaca22118, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.179428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.194557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1234/2459] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:16 2022] PUT /identity/v3/projects/1fc39b7bdf5e412a895a7ad87c363c6e/users/c42ff4cd555443e59e99e1fbaca22118/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:16.205728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.206018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.206333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.236596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] MFA Rules not processed for user `c42ff4cd555443e59e99e1fbaca22118`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:16.237761 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:16.310807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1226/2460] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:16.315975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.383243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8998a-d083-46d2-a042-9947762878ec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.390219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.392073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.392073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.392073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.392708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.394797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.429941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1235/2461] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:16 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:16.434122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.446685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f091137-5ca2-4867-babd-31da3760c21e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.529775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.532389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.532682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.532954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.533679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.536673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.560348 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1227/2462] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:16 2022] POST /identity/v3/users => generated 308 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:16.564621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.577691 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dac0ed-6358-400d-82ed-5fb7191b4b57 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.585463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.586771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.587053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.587325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.588510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.591052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.607351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1236/2463] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:16.612102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.623093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb7b50-4bf8-439f-8bfc-b0a49a5075a1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.628569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.629255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.629567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.629844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] PATH_INFO: `/v3/projects/58629f65b6e94784b1f5ce20b9b08c54/users/44e0caede7d0449d9fbd7e7ef7d27cc7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.633522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:16.647762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58629f65b6e94784b1f5ce20b9b08c54, user_id=44e0caede7d0449d9fbd7e7ef7d27cc7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.650644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.666594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1228/2464] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:16 2022] PUT /identity/v3/projects/58629f65b6e94784b1f5ce20b9b08c54/users/44e0caede7d0449d9fbd7e7ef7d27cc7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:16.671815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.681210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648cbef-e1d5-490c-b0e4-dca48f50325d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.749236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.749858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.750787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.751127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.751892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.754191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e250a-9203-4c23-a4f2-f05cde717bee admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.769105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1237/2465] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:16.769672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.781956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89040-9b01-447e-8b78-7c65c1aadee0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:16.787172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:16.787926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.788277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.788618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] PATH_INFO: `/v3/projects/58629f65b6e94784b1f5ce20b9b08c54/users/44e0caede7d0449d9fbd7e7ef7d27cc7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.791498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58629f65b6e94784b1f5ce20b9b08c54, user_id=44e0caede7d0449d9fbd7e7ef7d27cc7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:16.794552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:16.807188 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1229/2466] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:16 2022] PUT /identity/v3/projects/58629f65b6e94784b1f5ce20b9b08c54/users/44e0caede7d0449d9fbd7e7ef7d27cc7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:16.819526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:16.819815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:16.820086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:16.852596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] MFA Rules not processed for user `44e0caede7d0449d9fbd7e7ef7d27cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:16.854006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:16.904854 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:16.935569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1238/2467] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:16.947288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:16.949095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:17.052484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852c1d-7472-4406-90ca-78acc4061157 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:17.056497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:17.057215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:17.057724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:17.058284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:17.069404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:17.071008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256514b7-7dc4-451d-a4e8-35dd7efb42bb service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:17.089102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1230/2468] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:17.240085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:17.328797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239f26-4ec6-4e34-9d08-7a700b67e6e9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:17.333279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:17.333857 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:17.334162 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:17.334426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] PATH_INFO: `/v3/users/c42ff4cd555443e59e99e1fbaca22118` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:17.335557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42ff4cd555443e59e99e1fbaca22118)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:17.337467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:17.400247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42ff4cd555443e59e99e1fbaca22118'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:17.423318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42ff4cd555443e59e99e1fbaca22118'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:17.431188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42ff4cd555443e59e99e1fbaca22118'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:17.431972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42ff4cd555443e59e99e1fbaca22118'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:17.441870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42ff4cd555443e59e99e1fbaca22118'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:17.448839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1239/2469] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:17 2022] DELETE /identity/v3/users/c42ff4cd555443e59e99e1fbaca22118 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:17.459690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:17.459690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:17.459690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:17.480104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:17.481444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:17.555127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1231/2470] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:17.564968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:17.566422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:17.626995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dab2d-fd3a-464b-b09e-ca4251f78ab4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:17.631093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:17.631745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:17.631991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:17.632259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:17.643127 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:17.644578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:17.650687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:17.657060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1240/2471] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:17.997405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:17.999926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:18.020697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad469-9ceb-452e-9570-d8e1879254eb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:18.032069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:18.033108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.035376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.036076 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] PATH_INFO: `/v3/projects/1fc39b7bdf5e412a895a7ad87c363c6e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.037576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc39b7bdf5e412a895a7ad87c363c6e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:18.042091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:18.115266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc39b7bdf5e412a895a7ad87c363c6e', 'request_id': 'req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.117143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:18.126486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc39b7bdf5e412a895a7ad87c363c6e', 'request_id': 'req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.137678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc39b7bdf5e412a895a7ad87c363c6e', 'request_id': 'req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.152042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] The token cache is being invalidate because project 1fc39b7bdf5e412a895a7ad87c363c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:18.152420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.153257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.155347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1232/2472] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:17 2022] DELETE /identity/v3/projects/1fc39b7bdf5e412a895a7ad87c363c6e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:18.159122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:18.172597 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1179c2-f7b2-4f1d-9290-3a3e0c6d0b88 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:18.272613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:18.273680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.273680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.274298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] PATH_INFO: `/v3/users/44e0caede7d0449d9fbd7e7ef7d27cc7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.276215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e0caede7d0449d9fbd7e7ef7d27cc7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:18.278380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:18.342522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e0caede7d0449d9fbd7e7ef7d27cc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.356374 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e0caede7d0449d9fbd7e7ef7d27cc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.364410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e0caede7d0449d9fbd7e7ef7d27cc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.365225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e0caede7d0449d9fbd7e7ef7d27cc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.367318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:18.368800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:18.376078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e0caede7d0449d9fbd7e7ef7d27cc7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.384876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbfc2a-abb3-4e09-ac10-18c881d49bd2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:18.385276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1241/2473] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:18 2022] DELETE /identity/v3/users/44e0caede7d0449d9fbd7e7ef7d27cc7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:18.472431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:18.473023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.473298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.473569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] PATH_INFO: `/v3/users/41b9798ed3904162b6dfd473f68fca49` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.493142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b9798ed3904162b6dfd473f68fca49)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:18.494529 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:18.567003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b9798ed3904162b6dfd473f68fca49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.574767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b9798ed3904162b6dfd473f68fca49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.587765 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b9798ed3904162b6dfd473f68fca49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.588540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b9798ed3904162b6dfd473f68fca49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.600140 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b9798ed3904162b6dfd473f68fca49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.616942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1233/2474] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:18 2022] DELETE /identity/v3/users/41b9798ed3904162b6dfd473f68fca49 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:18.712177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:18.716044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:18.738713 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85840792-e273-47c7-9a13-e1502964d5a4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:18.806022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:18.806613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:18.806766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.806967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.807243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] PATH_INFO: `/v3/projects/58629f65b6e94784b1f5ce20b9b08c54` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.808367 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:18.808544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58629f65b6e94784b1f5ce20b9b08c54)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:18.810505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:18.823126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6b061-eaee-4384-aebe-e244044d5f19 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:18.828481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:18.829222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.830184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.830184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] PATH_INFO: `/v3/projects/01a29ae6853c465b9a07c693db3af786` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.849460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:18.851020 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a29ae6853c465b9a07c693db3af786)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:18.852961 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:18.878401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58629f65b6e94784b1f5ce20b9b08c54', 'request_id': 'req-9bd21b82-896c-482e-87dc-7dd319100c49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.886966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58629f65b6e94784b1f5ce20b9b08c54', 'request_id': 'req-9bd21b82-896c-482e-87dc-7dd319100c49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.893649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:18.895511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58629f65b6e94784b1f5ce20b9b08c54', 'request_id': 'req-9bd21b82-896c-482e-87dc-7dd319100c49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.909126 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] The token cache is being invalidate because project 58629f65b6e94784b1f5ce20b9b08c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:18.909503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a29ae6853c465b9a07c693db3af786', 'request_id': 'req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.909725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.910513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-9bd21b82-896c-482e-87dc-7dd319100c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.912341 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1242/2475] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:18 2022] DELETE /identity/v3/projects/58629f65b6e94784b1f5ce20b9b08c54 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:18.916756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a29ae6853c465b9a07c693db3af786', 'request_id': 'req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.917136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4a7e-97f2-49b5-88f3-5c54f81ddf50 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.917499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4a7e-97f2-49b5-88f3-5c54f81ddf50 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.917839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4a7e-97f2-49b5-88f3-5c54f81ddf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.926053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a29ae6853c465b9a07c693db3af786', 'request_id': 'req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.938352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] The token cache is being invalidate because project 01a29ae6853c465b9a07c693db3af786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:18.938693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.939072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-adee4a7e-97f2-49b5-88f3-5c54f81ddf50 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:18.939389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-81d5eccf-a8b2-4833-ad6f-5e03cfe2ff00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:18.940303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-adee4a7e-97f2-49b5-88f3-5c54f81ddf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:18.941071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1234/2476] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:18 2022] DELETE /identity/v3/projects/01a29ae6853c465b9a07c693db3af786 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:18.947134 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328858fa-d07c-4fd0-a9c3-61e1a5514b45 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:18.947610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328858fa-d07c-4fd0-a9c3-61e1a5514b45 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:18.948110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328858fa-d07c-4fd0-a9c3-61e1a5514b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:18.975554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-328858fa-d07c-4fd0-a9c3-61e1a5514b45 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:18.976788 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-328858fa-d07c-4fd0-a9c3-61e1a5514b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.003803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1243/2477] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:19.011548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.011835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.012137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.032038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:19.033256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.041609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1244/2478] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:19.044636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1235/2479] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:19.050528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.054344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.054557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.055296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.060498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3c88-139c-4ca4-8e4b-2a57f4b34c0b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.065632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.066282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.066563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.066837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.067490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:19.067803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.069430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.076693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:19.078212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.085609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1245/2480] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:19.086447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.087329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1236/2481] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:19.091805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.100694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861a8f3-b8b5-469c-abd7-8924d99bd814 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.101716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917bda-a33e-4493-b433-9a3c8bc709b4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.105499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.106202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.106485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.106641 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.106778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.107257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.107382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.107536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.107911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.108585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:19.109041 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.109315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.111821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.124559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1237/2482] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:19.129180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.142566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1246/2483] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:19.142771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30015c6-8779-41d0-9f05-9150327d8d4a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.143615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.202634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.203319 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.203625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.203901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.204535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.210572 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.213943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8a78b-48a2-47e2-99ee-fcf90f0f2143 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.219855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.220453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.220729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.220996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.221640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.223665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.240784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:19.241643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1238/2484] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:19.246671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.246843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1247/2485] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:19.250847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.261598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a387f-a427-4619-8cd5-2d4416df7f72 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.280516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:19.314918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fb76b-f802-4040-8d0c-5941be55745b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.319562 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.320169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.320452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.320726 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.321352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.322000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.322763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.323044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.323315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.323423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.323958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.325563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.336111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1248/2486] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:19.340617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.346321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1239/2487] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:19.350291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.351689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6449e-a67e-44a1-b0f1-fc121c0c8e4f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.356402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.356932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.357207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.357474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.358133 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.359772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.359880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53709047-ea8f-435b-81b6-dee5b7823d98 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.364417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.365018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.365328 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.365603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.366539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.368122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.371781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1249/2488] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:19.376338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.382603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1240/2489] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:19.385428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.389439 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb80c65-290e-40f9-acb3-b60e4b3fa9fe admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.394607 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.395256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.395566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.395801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] PATH_INFO: `/v3/projects/0acdcd038dee4f778652dc494efcda46/users/c3d564f628604a2b95653651a527adda/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.395940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a562f-bda0-44e7-a1c7-0b54154584ee admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.400476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.401073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.401354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.401625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.402292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.403904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.411117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acdcd038dee4f778652dc494efcda46, user_id=c3d564f628604a2b95653651a527adda, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.413759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c82a4-9b27-47ec-8f02-e93311071294 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.418508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1241/2490] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:19.419988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.429228 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1250/2491] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:19 2022] PUT /identity/v3/projects/0acdcd038dee4f778652dc494efcda46/users/c3d564f628604a2b95653651a527adda/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:19.431043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7e66-d70b-4aa3-bac2-1eb7d72c34a0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.440855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.441137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.441405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.470830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] MFA Rules not processed for user `c3d564f628604a2b95653651a527adda`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:19.472203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.491227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.491901 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.492169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.492436 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] PATH_INFO: `/v3/projects/3f6ef5d41de1494b99311176ddbb0617/users/3e3b8ebb962b4db18e8b07f130d57a7d/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.507653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6ef5d41de1494b99311176ddbb0617, user_id=3e3b8ebb962b4db18e8b07f130d57a7d, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.510337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266501-42e9-4ecc-be67-265a9dc94aec admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.524613 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1242/2492] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:19 2022] PUT /identity/v3/projects/3f6ef5d41de1494b99311176ddbb0617/users/3e3b8ebb962b4db18e8b07f130d57a7d/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:19.535724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.536030 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.536308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.541183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1251/2493] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:19.545513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.556203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f00ded-93c0-492f-8bc6-a0c76b2fa4fa None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.566311 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] MFA Rules not processed for user `3e3b8ebb962b4db18e8b07f130d57a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:19.567643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.603575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:19.618334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.618872 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.619236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.619540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.620192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.622214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.634971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1243/2494] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:19.647692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.649478 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:19.651667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1252/2495] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:19.655592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.660104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:19.726632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5327e7d-0d20-4f0d-8a33-df7c93010111 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.731767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.732516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.732927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.733075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.733659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.736270 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.740051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cc74a-57bd-4dbd-aaa6-11333a7936c2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.762946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1253/2496] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:19 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:19.764090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.774740 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563151a5-5329-4e73-9233-ab1fc6168b7d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.779698 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.780315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.780612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.780883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.782087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.783739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.795224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1254/2497] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:19.801236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.811675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75349a00-426a-44b6-9738-0e1dc01fdb21 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.816418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.817093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.817350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.817839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] PATH_INFO: `/v3/projects/a58941758e14466b83f671fb9a76647d/users/46859a08af0344b09d18c25d99b7bac6/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.820145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.820979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.821335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.822711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.839458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58941758e14466b83f671fb9a76647d, user_id=46859a08af0344b09d18c25d99b7bac6, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.842214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.862325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1255/2498] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:19 2022] PUT /identity/v3/projects/a58941758e14466b83f671fb9a76647d/users/46859a08af0344b09d18c25d99b7bac6/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:19.866673 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.884905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.886558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.896270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1244/2499] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:19.936992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1bf1a-d3ef-48d9-a30d-f5188c3ecd4e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.942782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.943431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.943671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.943941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.944694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.946489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fea3bc-39ab-4f40-bdd1-80234fb5f337 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.957531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1256/2500] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:19.961632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:19.973151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc338c-612d-4452-8247-eca72e0d96e1 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:19.977763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:19.978485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:19.978792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:19.979097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] PATH_INFO: `/v3/projects/a58941758e14466b83f671fb9a76647d/users/46859a08af0344b09d18c25d99b7bac6/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:19.981013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58941758e14466b83f671fb9a76647d, user_id=46859a08af0344b09d18c25d99b7bac6, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:19.983674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:19.995573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1245/2501] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:19 2022] PUT /identity/v3/projects/a58941758e14466b83f671fb9a76647d/users/46859a08af0344b09d18c25d99b7bac6/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:20.006331 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:20.006620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:20.006893 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:20.037726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] MFA Rules not processed for user `46859a08af0344b09d18c25d99b7bac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:20.039082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:20.052908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:20.118729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1257/2502] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:20.130261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:20.132036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:20.190371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:20.230049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0ccce-f9f3-4f14-934d-8011e6833fa5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:20.234107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:20.235324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:20.235669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:20.236110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:20.250860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:20.253282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c804c-5e63-4c58-8a6c-a9d4e08db51a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:20.267452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1246/2503] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:20.709931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:20.777478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd5fe-3c14-4e29-b96a-7df0819a6f0c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:20.783710 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:20.784382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:20.784747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:20.785074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] PATH_INFO: `/v3/users/c3d564f628604a2b95653651a527adda` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:20.786445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d564f628604a2b95653651a527adda)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:20.788378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:20.842230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d564f628604a2b95653651a527adda'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:20.856161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d564f628604a2b95653651a527adda'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:20.864548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d564f628604a2b95653651a527adda'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:20.865420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d564f628604a2b95653651a527adda'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:20.874968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d564f628604a2b95653651a527adda'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:20.881928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1258/2504] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:20 2022] DELETE /identity/v3/users/c3d564f628604a2b95653651a527adda => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:20.886590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:20.886895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:20.887329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:20.909046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:20.910205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:20.971086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1247/2505] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:20.981741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:20.983419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:21.016319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:21.045581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3335f-816d-4b27-9c6b-325fa4b63579 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:21.049687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:21.050316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:21.050595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:21.050868 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:21.060730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:21.062190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:21.072564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1259/2506] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:21.372487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:21.374110 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:21.388622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758930f6-ccba-4f76-aad0-bcfff341849a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:21.395091 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:21.395707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:21.395983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:21.396257 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] PATH_INFO: `/v3/projects/0acdcd038dee4f778652dc494efcda46` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:21.397444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acdcd038dee4f778652dc494efcda46)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:21.399393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:21.463018 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acdcd038dee4f778652dc494efcda46', 'request_id': 'req-63636dc1-cc34-4597-97d3-9ff84e5ec447'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.475958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acdcd038dee4f778652dc494efcda46', 'request_id': 'req-63636dc1-cc34-4597-97d3-9ff84e5ec447'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.489027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acdcd038dee4f778652dc494efcda46', 'request_id': 'req-63636dc1-cc34-4597-97d3-9ff84e5ec447'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.502945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] The token cache is being invalidate because project 0acdcd038dee4f778652dc494efcda46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:21.503241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.503906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.505406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1248/2507] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:21 2022] DELETE /identity/v3/projects/0acdcd038dee4f778652dc494efcda46 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:21.509890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:21.521244 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ea73a-f5c6-4a75-8a76-b9fdb174eaf7 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:21.595542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:21.596275 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:21.596643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:21.596925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] PATH_INFO: `/v3/users/46859a08af0344b09d18c25d99b7bac6` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:21.599014 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46859a08af0344b09d18c25d99b7bac6)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:21.601273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:21.660073 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46859a08af0344b09d18c25d99b7bac6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.673483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46859a08af0344b09d18c25d99b7bac6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.680811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46859a08af0344b09d18c25d99b7bac6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.681633 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46859a08af0344b09d18c25d99b7bac6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.690994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e517e71c-39cb-4b2a-9a3d-4b0dab5f069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46859a08af0344b09d18c25d99b7bac6'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:21.697674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1260/2508] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:21 2022] DELETE /identity/v3/users/46859a08af0344b09d18c25d99b7bac6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:22.005124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.006650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.020853 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636dc1-cc34-4597-97d3-9ff84e5ec447 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.071409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:22.080259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.081005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.081482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.081915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] PATH_INFO: `/v3/projects/a58941758e14466b83f671fb9a76647d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.083387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58941758e14466b83f671fb9a76647d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.085403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.134913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58941758e14466b83f671fb9a76647d', 'request_id': 'req-083a6967-de01-4b24-b224-ff30e3668638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.141680 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58941758e14466b83f671fb9a76647d', 'request_id': 'req-083a6967-de01-4b24-b224-ff30e3668638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.149425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58941758e14466b83f671fb9a76647d', 'request_id': 'req-083a6967-de01-4b24-b224-ff30e3668638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.160665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] The token cache is being invalidate because project a58941758e14466b83f671fb9a76647d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:22.160983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.161716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-083a6967-de01-4b24-b224-ff30e3668638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.163127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1249/2509] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:22 2022] DELETE /identity/v3/projects/a58941758e14466b83f671fb9a76647d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:22.167985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.168461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.168558 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.190510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:22.191747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.237294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:22.254518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1261/2510] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:22.262554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.262840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.263122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.283027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:22.284236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.291956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1250/2511] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:22.296605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.308229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caca5b-acbe-48b0-880a-29958b8f32e9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.314239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.314852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.315132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.315404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.316052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:22.316355 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.317973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.330760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1262/2512] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:22.335561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.345344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b704-d9d4-4903-af36-045532a43a08 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.352770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.353857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.354420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.354926 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.356068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.360184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.402502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1251/2513] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:22.406491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.416780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b20dc4-5205-4be4-b61f-60c919f3a305 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.476853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.477284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.477553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.477824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.478502 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.480474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.503730 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1263/2514] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:22.508099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.518710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8cf92-d3ba-403a-8538-6390865b87cb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.523434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.524046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.524323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.524594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.525230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.526862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.537525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1252/2515] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:22.541689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.553602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b06fcf-8173-459e-91e8-5ae268e71308 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.558516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.559119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.559396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.559665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.560313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.561916 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f52ec-f7b4-43a8-acc6-658122b2590b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.573768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1264/2516] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:22.578439 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.588701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca123a2-ee51-4f99-8720-94b640fc26aa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.594800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.595557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.595888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.596212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] PATH_INFO: `/v3/projects/045a2becf1234792904b78b6ec9d52c7/users/664c54d5673b4ccc9da8e7025b54f1c1/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.618470 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045a2becf1234792904b78b6ec9d52c7, user_id=664c54d5673b4ccc9da8e7025b54f1c1, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.621483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.638012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1253/2517] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:22 2022] PUT /identity/v3/projects/045a2becf1234792904b78b6ec9d52c7/users/664c54d5673b4ccc9da8e7025b54f1c1/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:22.649809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.650116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.650390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.682145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] MFA Rules not processed for user `664c54d5673b4ccc9da8e7025b54f1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:22.683462 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.710216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.712064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.769103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1265/2518] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:22.774104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.790881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317cad4-323d-4831-9bbf-9418fe1a5ff9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.795904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.796566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.796841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.797689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] PATH_INFO: `/v3/users/3e3b8ebb962b4db18e8b07f130d57a7d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.798984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e3b8ebb962b4db18e8b07f130d57a7d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.800988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.824722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:22.826523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:22.852333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d01b-8f74-4a8b-ba73-5c032121b0a5 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.857233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:22.857890 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.858196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.858470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.859273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:22.860924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e3b8ebb962b4db18e8b07f130d57a7d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.861830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:22.869207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e3b8ebb962b4db18e8b07f130d57a7d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.882792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e3b8ebb962b4db18e8b07f130d57a7d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.883635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e3b8ebb962b4db18e8b07f130d57a7d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.896443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1266/2519] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:22.896742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f22938c7-7746-4108-9331-3d6a12a8cc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e3b8ebb962b4db18e8b07f130d57a7d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:22.897541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:22.899542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.900877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1254/2520] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:22 2022] DELETE /identity/v3/users/3e3b8ebb962b4db18e8b07f130d57a7d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:22.907628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:22.907911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:22.908200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:22.927849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:22.929136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:22.976915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0c439-0920-4a32-a13f-2efad9b2f92d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:22.997261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1255/2521] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:23.008123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.010735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.042028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.042711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.042999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.043278 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.043917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.045856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.069930 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1267/2522] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:22 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:23.073957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.076836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207867c5-757c-483c-9ade-7999eeb7f56b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.081100 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.081763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.082136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.082390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.092077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.092580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474224-fe47-4b0b-a63d-d303ddc201f6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.093535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.101094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.102175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.102669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.103007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.103974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.104364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1256/2523] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:54:23.106812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.120743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1268/2524] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:23.124892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.134945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00c82-f01f-4b83-9944-28c785fe4882 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.139749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.140434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.141261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.141541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] PATH_INFO: `/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0/users/cf600329ffcc470c8d109d151246f16a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.160393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0b70957da4522a53f3d5f9fdf79c0, user_id=cf600329ffcc470c8d109d151246f16a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.163668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.182689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1257/2525] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:23 2022] PUT /identity/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0/users/cf600329ffcc470c8d109d151246f16a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:23.184795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.196175 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7dbef-086b-4b5b-9315-dad2f9b942aa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.253193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:23.260728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.261351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.262290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.262290 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.262606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.264195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265aa35-0147-43a1-8fb0-b5811df17880 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.275531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1269/2526] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:23.279884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.292651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f379b02-759d-41e4-8307-7b29c521b3fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.297540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.298335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.298724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.299045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] PATH_INFO: `/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0/users/cf600329ffcc470c8d109d151246f16a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.301068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e0b70957da4522a53f3d5f9fdf79c0, user_id=cf600329ffcc470c8d109d151246f16a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.303839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.316088 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1258/2527] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:23 2022] PUT /identity/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0/users/cf600329ffcc470c8d109d151246f16a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:23.327138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.327543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.327671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.360514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] MFA Rules not processed for user `cf600329ffcc470c8d109d151246f16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:23.361950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.427125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.429362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.444169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:23.465557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1270/2528] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:23.476996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.478522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.516834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44d383-dfdc-437c-b113-b91969eabd7e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.521812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.522486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.522923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.523053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] PATH_INFO: `/v3/projects/3f6ef5d41de1494b99311176ddbb0617` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.524503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6ef5d41de1494b99311176ddbb0617)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.526491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.550922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3512365-c9cb-46e6-a1ed-97c5c374dfff None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.554803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.555394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.555707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.555940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.566328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.567784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8610a-a733-4102-afe1-357436dfe3e1 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.575975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6ef5d41de1494b99311176ddbb0617', 'request_id': 'req-a5256106-d507-4da2-a40b-2ddedfd6e90f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:23.578002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1271/2529] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:54:23.583609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6ef5d41de1494b99311176ddbb0617', 'request_id': 'req-a5256106-d507-4da2-a40b-2ddedfd6e90f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:23.591885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6ef5d41de1494b99311176ddbb0617', 'request_id': 'req-a5256106-d507-4da2-a40b-2ddedfd6e90f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:23.605335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] The token cache is being invalidate because project 3f6ef5d41de1494b99311176ddbb0617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:23.605611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:23.606392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:23.607884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1259/2530] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:23 2022] DELETE /identity/v3/projects/3f6ef5d41de1494b99311176ddbb0617 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:23.612923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a555-46fe-4f14-83e1-0e99dfb441dc None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.613207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a555-46fe-4f14-83e1-0e99dfb441dc None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.613475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407a555-46fe-4f14-83e1-0e99dfb441dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.636216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d407a555-46fe-4f14-83e1-0e99dfb441dc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:23.637763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d407a555-46fe-4f14-83e1-0e99dfb441dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.672122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.673568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.705419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1272/2531] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:23.713344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a576-59a0-47d7-956a-45523503b70b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.713629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a576-59a0-47d7-956a-45523503b70b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.713903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460a576-59a0-47d7-956a-45523503b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.733360 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b460a576-59a0-47d7-956a-45523503b70b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:23.735180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b460a576-59a0-47d7-956a-45523503b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.737119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256106-d507-4da2-a40b-2ddedfd6e90f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.740924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.742535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.742535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.742535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.743870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1273/2532] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:23.744647 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:23.748090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460a576-59a0-47d7-956a-45523503b70b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.758406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460a576-59a0-47d7-956a-45523503b70b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.763153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.763756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.764035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.764309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.764974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:23.765265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.767033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.779265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1274/2533] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:23.783453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.788731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:23.797418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879301a0-4fb6-4c49-88c7-9ab5070c3fc7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.802806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.803348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.803626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.803897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.804530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.806532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.824899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:23.836996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1275/2534] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:23 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:23.838863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.840454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.840881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.851298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1260/2535] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:23.921463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf34c-5338-4f8b-a32c-b57bd752f503 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.927206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.927817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.928098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.928373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.929005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.930977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:23.965453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1276/2536] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:23 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:23.966905 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:23.979836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cc68-10e0-4a91-9796-ef7d4ec62ec4 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:23.986672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:23.987333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:23.987593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:23.987875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:23.988721 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:23.990271 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.003500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1261/2537] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:24.007363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.017588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780ef9-8698-4c26-ba09-4e95f8e9aff1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.022432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.023049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.023337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.023610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.024271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.025875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03d93-3ba2-4989-b239-a168d7a77427 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.036709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1277/2538] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:24.040999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.051693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d9da1-20b2-41b6-aefc-8e61b5a165dc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.056401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.056998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.057282 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.057558 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] PATH_INFO: `/v3/projects/6bcfb643874b4545b7db06ed6697965b/users/facd5a482f2b4223a0171aa1a9f2d99a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.072985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bcfb643874b4545b7db06ed6697965b, user_id=facd5a482f2b4223a0171aa1a9f2d99a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.075660 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.089090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1262/2539] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:24 2022] PUT /identity/v3/projects/6bcfb643874b4545b7db06ed6697965b/users/facd5a482f2b4223a0171aa1a9f2d99a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:24.101348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.101631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.101910 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.131050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] MFA Rules not processed for user `facd5a482f2b4223a0171aa1a9f2d99a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:24.132277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:24.199829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1278/2540] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:24.204630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.268910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379c0e0-dd67-4048-bf71-1f06a132b1ea admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.273522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.274172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.274449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.274720 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.275353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.277261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.306506 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1263/2541] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:24 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:24.310867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.321644 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc296191-478b-4bb6-84b5-e42eb9051a6c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.369198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:24.387430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.388125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.388404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.388702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.389445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.391448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.413992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1279/2542] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:24 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:24.417567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.428577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb177-e383-41a6-b26e-10ef5059d827 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.433293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.433896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.434226 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.434502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.439163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.440921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.452453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1264/2543] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:24.457112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.468382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6b3f-816e-45b3-bd55-b4081384903a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.473923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.474628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.474903 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.475169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] PATH_INFO: `/v3/projects/e4b8e068abda46b1841bd87003b6e188/users/76ef78f82cc048ddb3d7b33849570129/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.492956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b8e068abda46b1841bd87003b6e188, user_id=76ef78f82cc048ddb3d7b33849570129, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.495682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.510771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1280/2544] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:24 2022] PUT /identity/v3/projects/e4b8e068abda46b1841bd87003b6e188/users/76ef78f82cc048ddb3d7b33849570129/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:24.514913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.525385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496458-d522-4dbb-b9d4-223a2ec4e38c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.583340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.583918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.584205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.584483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.585127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.586758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910d8f9-71d8-468f-974d-4e9f6ce550eb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.597332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1265/2545] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:24.601696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.612038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2c4f2-5a70-49e0-a16d-d7de670a4a5e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.616972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.617616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.617886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.618182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] PATH_INFO: `/v3/projects/e4b8e068abda46b1841bd87003b6e188/users/76ef78f82cc048ddb3d7b33849570129/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.620317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b8e068abda46b1841bd87003b6e188, user_id=76ef78f82cc048ddb3d7b33849570129, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.622965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.633357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1281/2546] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:24 2022] PUT /identity/v3/projects/e4b8e068abda46b1841bd87003b6e188/users/76ef78f82cc048ddb3d7b33849570129/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:24.644315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.644315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.644315 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.673601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] MFA Rules not processed for user `76ef78f82cc048ddb3d7b33849570129`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:24.674881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:24.687845 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:24.745172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1266/2547] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:24.757213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.819204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3ad4-17fe-4f5d-980f-c3d24ff0a7b6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.823018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.823642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.823918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.824191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:24.834927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:24.836465 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:24.848661 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1282/2548] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:24.929747 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:24.940162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c4d0b-22f6-47eb-90cc-d7b601482b0e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:24.943882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:24.944514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:24.944793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:24.945066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:25.005880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:25.007391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36941293-b44b-4e27-84b3-4578e5663d60 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:25.017312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1267/2549] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:54:26.656907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:26.658419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:26.734291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f76e6e-26e4-4249-9c49-706d11ca5d6d service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:26.739471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:26.740099 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:26.740411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:26.740645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] PATH_INFO: `/v3/users/664c54d5673b4ccc9da8e7025b54f1c1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:26.742203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664c54d5673b4ccc9da8e7025b54f1c1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:26.744066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:26.789189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:26.790716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664c54d5673b4ccc9da8e7025b54f1c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:26.804453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664c54d5673b4ccc9da8e7025b54f1c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:26.811856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664c54d5673b4ccc9da8e7025b54f1c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:26.812627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664c54d5673b4ccc9da8e7025b54f1c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:26.819676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664c54d5673b4ccc9da8e7025b54f1c1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:26.825951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1283/2550] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:26 2022] DELETE /identity/v3/users/664c54d5673b4ccc9da8e7025b54f1c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:26.831120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:26.831588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:26.831725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:26.852318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:26.853537 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:26.913376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1268/2551] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:26.923273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:26.924674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:26.992469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd9143-328c-4e34-878e-31993c23e9c1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:26.996707 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:26.997333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:26.997606 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:26.997875 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:27.007954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:27.009495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:27.021269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1284/2552] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:27.315624 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:27.317092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:27.330354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f036880-5033-46f5-8fc2-07e9023fb7c5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:27.335604 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:27.336261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:27.336538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:27.336809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] PATH_INFO: `/v3/projects/045a2becf1234792904b78b6ec9d52c7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:27.337951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=045a2becf1234792904b78b6ec9d52c7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:27.339925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:27.388067 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:27.392775 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045a2becf1234792904b78b6ec9d52c7', 'request_id': 'req-edcd6788-d585-4669-9366-7e0f0fe48bca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.399819 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045a2becf1234792904b78b6ec9d52c7', 'request_id': 'req-edcd6788-d585-4669-9366-7e0f0fe48bca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.407858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045a2becf1234792904b78b6ec9d52c7', 'request_id': 'req-edcd6788-d585-4669-9366-7e0f0fe48bca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.418945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] The token cache is being invalidate because project 045a2becf1234792904b78b6ec9d52c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:27.419236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.419874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.421364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1269/2553] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:27 2022] DELETE /identity/v3/projects/045a2becf1234792904b78b6ec9d52c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:27.425568 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:27.435602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd991be-bbbc-44d8-bb3c-d9ebaf01be0f service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:27.493191 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:27.493814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:27.494121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:27.494390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] PATH_INFO: `/v3/users/cf600329ffcc470c8d109d151246f16a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:27.495535 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf600329ffcc470c8d109d151246f16a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:27.497458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:27.544229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf600329ffcc470c8d109d151246f16a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.556874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf600329ffcc470c8d109d151246f16a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.559085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:27.566560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf600329ffcc470c8d109d151246f16a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.568024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf600329ffcc470c8d109d151246f16a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.579653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-c8c3a798-4e7e-45a7-be8a-3b87ae3c8f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf600329ffcc470c8d109d151246f16a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:27.587676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1285/2554] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:27 2022] DELETE /identity/v3/users/cf600329ffcc470c8d109d151246f16a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:27.899283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:27.901225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:27.927781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6788-d585-4669-9366-7e0f0fe48bca admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:27.991950 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:27.992883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:27.993162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:27.993432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] PATH_INFO: `/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:27.994692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e0b70957da4522a53f3d5f9fdf79c0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:27.996863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.053814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e0b70957da4522a53f3d5f9fdf79c0', 'request_id': 'req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:28.060349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e0b70957da4522a53f3d5f9fdf79c0', 'request_id': 'req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:28.068631 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e0b70957da4522a53f3d5f9fdf79c0', 'request_id': 'req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:28.079588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] The token cache is being invalidate because project f3e0b70957da4522a53f3d5f9fdf79c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:28.079875 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:28.080538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ac62046c-a036-48a4-bfa7-eb85b2cb5e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:28.082060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1270/2555] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:27 2022] DELETE /identity/v3/projects/f3e0b70957da4522a53f3d5f9fdf79c0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:28.087174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.087794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.087794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.110520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:28.111832 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:28.172576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1286/2556] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:28.181525 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.181825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.182129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.203057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:28.204289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:28.212327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1271/2557] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:28.217115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.228369 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd79b0-82e4-40eb-acdd-f6bf0eea626a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.232972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.233645 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.233914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.234161 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.235424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:28.235729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.237408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.253250 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1287/2558] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:28.258427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.268689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9f8f4-271f-4c79-b93e-621df6de4754 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.273573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.274228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.274511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.274785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.275428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.277380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.312185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1272/2559] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:28.317149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.328131 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ca4e-8226-4464-9c82-2948a8ae71b5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.393605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.394243 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.394517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.394783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.395403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.397783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.421112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1288/2560] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:28.425382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.435733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e174-b76d-423d-8cdb-3d858b1768dc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.440501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.442162 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.442448 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.442724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.443372 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.444980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.455575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1273/2561] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:28.459693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.470604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b000fee-766d-4afc-936f-f4f3a08eb5fd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.475466 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.476078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.476356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.476620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.477259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.478919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610307-1517-412d-a146-b67ed133d4d2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.490426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1289/2562] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:28.497177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.510494 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84627f4-5593-4be8-92e8-6d6e89ac3045 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.518686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.519770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.520151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.520532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] PATH_INFO: `/v3/projects/07832d91e2274d07925e3521fe90097f/users/9bc16971cebc4eaba239b1f62e636178/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.536693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07832d91e2274d07925e3521fe90097f, user_id=9bc16971cebc4eaba239b1f62e636178, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.539416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.549447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:28.554561 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1274/2563] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:28 2022] PUT /identity/v3/projects/07832d91e2274d07925e3521fe90097f/users/9bc16971cebc4eaba239b1f62e636178/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:28.566304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.566563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.566748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.598858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] MFA Rules not processed for user `9bc16971cebc4eaba239b1f62e636178`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:28.600114 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:28.643018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:28.669019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1290/2564] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:28.673670 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.737828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7eed7-fb7e-464f-b445-6fbf48ee0304 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.742424 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.743044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.743323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.743594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.744224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.746221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.775417 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1275/2565] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:28.779704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.791576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd008932-148b-4204-8761-523b6f4f1b7b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.849510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.850154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.850434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.850703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.851335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.853291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.880988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1291/2566] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:28 2022] POST /identity/v3/users => generated 306 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:28.885005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.896520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b5b79-39fa-44c4-9da8-3e6d204f37d3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.901190 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.902099 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.902383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.902652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.903292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.904880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.919650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1276/2567] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:28.920881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:28.931467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9172491-f71a-4619-a2d0-de1f19fecdc5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:28.936783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:28.937472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:28.938293 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:28.938569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] PATH_INFO: `/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832/users/37341cdef04a4ef8a978eee8566ff1a3/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:28.956621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5e9468e4ab4c28b00d85acbbf4e832, user_id=37341cdef04a4ef8a978eee8566ff1a3, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:28.959888 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:28.987112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1292/2568] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:28 2022] PUT /identity/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832/users/37341cdef04a4ef8a978eee8566ff1a3/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:28.993026 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:29.004414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21f32f-9def-47ec-9c54-7165eaf8126a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:29.073600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:29.074250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:29.074533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:29.074807 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:29.075454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:29.077046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0d0bf-cb54-4316-ac29-c98318d6dcb1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:29.090882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1277/2569] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:29.092337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:29.106835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6599-c1ce-4be7-9351-c82d5abd62f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:29.112184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:29.112965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:29.113249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:29.113519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] PATH_INFO: `/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832/users/37341cdef04a4ef8a978eee8566ff1a3/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:29.117514 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5e9468e4ab4c28b00d85acbbf4e832, user_id=37341cdef04a4ef8a978eee8566ff1a3, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:29.120672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:29.132954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1293/2570] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:29 2022] PUT /identity/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832/users/37341cdef04a4ef8a978eee8566ff1a3/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:29.154280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:29.154567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:29.154827 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:29.188628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] MFA Rules not processed for user `37341cdef04a4ef8a978eee8566ff1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:29.190045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:29.265205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:29.279175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1278/2571] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:29.295387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:29.297986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:29.385914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd066-77ac-4897-9dfa-ea4b8c63377d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:29.391344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:29.392052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:29.392397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:29.393289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:29.406557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:29.410172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:29.428480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1294/2572] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:29.531105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:29.548343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e70b-66a2-42f9-84df-0848fb5ae8da None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:29.554970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:29.556038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:29.556609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:29.557120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:29.664373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:29.666090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d760a-52b2-4f34-8732-ff850df947bb service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:29.678990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1279/2573] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:54:33.809917 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:33.851449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:33.880264 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4ed7-10fe-4a71-b0c8-fdb0333347df service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:33.885137 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:33.885795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:33.886085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:33.886391 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] PATH_INFO: `/v3/users/9bc16971cebc4eaba239b1f62e636178` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:33.887968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc16971cebc4eaba239b1f62e636178)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:33.890655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:33.940087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc16971cebc4eaba239b1f62e636178'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:33.951768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc16971cebc4eaba239b1f62e636178'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:33.961298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc16971cebc4eaba239b1f62e636178'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:33.962021 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc16971cebc4eaba239b1f62e636178'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:33.970195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc16971cebc4eaba239b1f62e636178'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:33.976337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1295/2574] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:33 2022] DELETE /identity/v3/users/9bc16971cebc4eaba239b1f62e636178 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:33.981036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:33.981532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:33.981619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:34.012192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:34.012673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:34.075584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1280/2575] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:34.086265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:34.087690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:34.145428 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6e878-7823-4496-8066-93909642d2e7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:34.149247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:34.149859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:34.150160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:34.150430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:34.159852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:34.161294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:34.171977 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1296/2576] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:34.442899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:34.444366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:34.457984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87523c32-7e9f-4936-a59c-20b5417abcb7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:34.463485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:34.464180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:34.464468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:34.464742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] PATH_INFO: `/v3/projects/07832d91e2274d07925e3521fe90097f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:34.465888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07832d91e2274d07925e3521fe90097f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:34.467867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:34.521308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07832d91e2274d07925e3521fe90097f', 'request_id': 'req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.527844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07832d91e2274d07925e3521fe90097f', 'request_id': 'req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.535946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07832d91e2274d07925e3521fe90097f', 'request_id': 'req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.549408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] The token cache is being invalidate because project 07832d91e2274d07925e3521fe90097f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:34.549691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.551127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.552701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1281/2577] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:34 2022] DELETE /identity/v3/projects/07832d91e2274d07925e3521fe90097f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:34.556668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:34.567837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a24b89-e41e-4259-be6d-5f4b915fc7cb service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:34.619768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:34.627643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:34.628398 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:34.628615 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:34.629219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] PATH_INFO: `/v3/users/37341cdef04a4ef8a978eee8566ff1a3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:34.630770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37341cdef04a4ef8a978eee8566ff1a3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:34.632962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:34.681768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37341cdef04a4ef8a978eee8566ff1a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.694043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37341cdef04a4ef8a978eee8566ff1a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.701346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37341cdef04a4ef8a978eee8566ff1a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.702156 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37341cdef04a4ef8a978eee8566ff1a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.710227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-8d7ddf79-a25e-422d-9bb5-c19e27ca5d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37341cdef04a4ef8a978eee8566ff1a3'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:34.717029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1297/2578] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:34 2022] DELETE /identity/v3/users/37341cdef04a4ef8a978eee8566ff1a3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:35.042912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.044676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:35.061118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3389e-ea33-41cf-9af7-2e5e299a9f18 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.080350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:35.130480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.131126 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.131405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.131677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] PATH_INFO: `/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.132870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5e9468e4ab4c28b00d85acbbf4e832)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.134822 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.185554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5e9468e4ab4c28b00d85acbbf4e832', 'request_id': 'req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:35.192172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5e9468e4ab4c28b00d85acbbf4e832', 'request_id': 'req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:35.200387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5e9468e4ab4c28b00d85acbbf4e832', 'request_id': 'req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:35.212543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] The token cache is being invalidate because project ac5e9468e4ab4c28b00d85acbbf4e832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:35.212754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:35.213389 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-15b522f4-1bf6-4c7b-8096-4b1773cc9d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:35.214956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1282/2579] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:35 2022] DELETE /identity/v3/projects/ac5e9468e4ab4c28b00d85acbbf4e832 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:35.220669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.221234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.221234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.242819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:35.244052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:35.311111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1298/2580] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:35.321201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.321489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.321780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.343290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:35.345089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:35.353243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1283/2581] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:35.358318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.369776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd62b-f4ef-4dd0-8416-2733230ef4ec None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.374790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.375420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.375697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.375968 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.376623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:35.376924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.378594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.396616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1299/2582] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:35.401423 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.411881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d606b6-e083-4b5e-b298-44c2b04b611a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.416633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.417248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.417541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.417804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.418474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.420391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.451502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1284/2583] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:35.455737 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.466454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67113a91-4e39-48ba-b8a2-2f5d91aaf422 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.523670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.524291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.524546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.524811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.525427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.527999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.538906 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:35.554239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1300/2584] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:35.557150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.567479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c849d9-36a2-4e83-af1d-99e8c5f17e3f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.572169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.572773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.573065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.573343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.573990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.575688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.585951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1285/2585] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:35.590142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.600921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a7dea-f82a-4cc3-8b2e-0550b0c995d3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.605729 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.606383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.606657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.606931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.607582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.609180 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2768cc1-aabd-47c7-84d0-5f32bfcc49c5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.620835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1301/2586] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:35.625137 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.635455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819fce-78f7-4d29-b1a8-008f37e78627 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.640242 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.641125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.641406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.641686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] PATH_INFO: `/v3/projects/4a2b240065e2480bb6ef135d55c32921/users/bda93f2331fd4ef7bcff55ca3d6efae2/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.656945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2b240065e2480bb6ef135d55c32921, user_id=bda93f2331fd4ef7bcff55ca3d6efae2, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.659616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.673518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1286/2587] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:35 2022] PUT /identity/v3/projects/4a2b240065e2480bb6ef135d55c32921/users/bda93f2331fd4ef7bcff55ca3d6efae2/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:35.683986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.684273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.684545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.712144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] MFA Rules not processed for user `bda93f2331fd4ef7bcff55ca3d6efae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:35.713368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:35.779067 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1302/2588] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:35.784129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.830051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:35.850495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dc6de-fe45-4a43-bb13-564a3ae0b27f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.855138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.855741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.856017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.856285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.856906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.858817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.885291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1287/2589] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:35.889463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.901534 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffc9a0-fa93-4bc4-9cf7-b8d7b1faf60a None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:35.957630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:35.958260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:35.958537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:35.958815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:35.959421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:35.961339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:35.986159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1303/2590] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:35 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:35.987407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:35.997855 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57cc84-dd36-4871-b8d9-a2c41599c08f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.002387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.002983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.003287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.003557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.004229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.006181 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.017404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1288/2591] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:36.021587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:36.033349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e15848-a6c3-4e0a-836f-65693d88cf9c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.038203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.039036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.039138 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.039382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] PATH_INFO: `/v3/projects/952082cd079744cc99d3841fcef8ac69/users/2525cac84205404f80ebc4a04ea1f61d/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.055029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952082cd079744cc99d3841fcef8ac69, user_id=2525cac84205404f80ebc4a04ea1f61d, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.057940 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.072233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1304/2592] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:36 2022] PUT /identity/v3/projects/952082cd079744cc99d3841fcef8ac69/users/2525cac84205404f80ebc4a04ea1f61d/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:36.076019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:36.086663 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab205d0-5b2d-4ce1-bcfd-173ddd22b245 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.145102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.145706 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.146037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.146370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.147010 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.148632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2b29-d739-45f0-b47c-72d7b5ae0f39 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.161982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1289/2593] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:36.163159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:36.173412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1d496-97c2-41d3-8304-5b5d46baea66 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.178483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.179609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.179947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.180249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] PATH_INFO: `/v3/projects/952082cd079744cc99d3841fcef8ac69/users/2525cac84205404f80ebc4a04ea1f61d/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.182405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952082cd079744cc99d3841fcef8ac69, user_id=2525cac84205404f80ebc4a04ea1f61d, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.185985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.197454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1305/2594] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:36 2022] PUT /identity/v3/projects/952082cd079744cc99d3841fcef8ac69/users/2525cac84205404f80ebc4a04ea1f61d/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:36.208603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.208937 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.209171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.238704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] MFA Rules not processed for user `2525cac84205404f80ebc4a04ea1f61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:36.239925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:36.339354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1290/2595] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:36.346819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:36.348759 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:36.387736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:36.428522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39803-c1ee-4883-8834-133ed7222137 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.432748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.433422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.433762 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.434280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.445590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.447082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2456181-96b0-4b3d-9e49-807fea1a9e52 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.457336 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1306/2596] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:36.828216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:36.872006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:36.893086 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b83f9-15e1-43d6-8c7a-394857f95d4b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:36.897500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:36.898171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.898449 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.898719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] PATH_INFO: `/v3/users/bda93f2331fd4ef7bcff55ca3d6efae2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:36.899825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda93f2331fd4ef7bcff55ca3d6efae2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:36.901904 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:36.953831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda93f2331fd4ef7bcff55ca3d6efae2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:36.960676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda93f2331fd4ef7bcff55ca3d6efae2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:36.973420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda93f2331fd4ef7bcff55ca3d6efae2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:36.974254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda93f2331fd4ef7bcff55ca3d6efae2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:36.982379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda93f2331fd4ef7bcff55ca3d6efae2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:36.989065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1291/2597] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:36 2022] DELETE /identity/v3/users/bda93f2331fd4ef7bcff55ca3d6efae2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:36.993867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:36.994196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:36.994469 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:37.013223 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:37.014670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:37.076333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1307/2598] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:37.085945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:37.087523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:37.145907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08454782-a5f6-4a9c-83bb-aa6c915f5fca admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:37.149553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:37.150193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:37.150476 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:37.150751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:37.160375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:37.161809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:37.171251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1292/2599] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:37.442269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:37.443722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:37.456861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6c960-ca91-4c35-ab22-cfaddedba8b3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:37.462353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:37.462994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:37.463501 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:37.463772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] PATH_INFO: `/v3/projects/4a2b240065e2480bb6ef135d55c32921` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:37.464911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2b240065e2480bb6ef135d55c32921)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:37.466863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:37.525295 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2b240065e2480bb6ef135d55c32921', 'request_id': 'req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.533109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2b240065e2480bb6ef135d55c32921', 'request_id': 'req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.543112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2b240065e2480bb6ef135d55c32921', 'request_id': 'req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.554843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] The token cache is being invalidate because project 4a2b240065e2480bb6ef135d55c32921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:37.555135 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.555780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.557279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1308/2600] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:37 2022] DELETE /identity/v3/projects/4a2b240065e2480bb6ef135d55c32921 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:37.561395 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:37.571243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a54c2-23f0-4211-a173-9ad23b207523 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:37.635053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:37.635616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:37.635894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:37.636164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] PATH_INFO: `/v3/users/2525cac84205404f80ebc4a04ea1f61d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:37.637375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2525cac84205404f80ebc4a04ea1f61d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:37.639442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:37.642801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:37.697360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2525cac84205404f80ebc4a04ea1f61d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.705122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2525cac84205404f80ebc4a04ea1f61d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.718262 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2525cac84205404f80ebc4a04ea1f61d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.719104 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2525cac84205404f80ebc4a04ea1f61d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.727057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec82c0d6-4367-4b2c-92eb-2e92efcc87ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2525cac84205404f80ebc4a04ea1f61d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:37.733890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1293/2601] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:37 2022] DELETE /identity/v3/users/2525cac84205404f80ebc4a04ea1f61d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:38.056599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.058211 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:38.072637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30341d-6f53-437c-ab88-bf7f5c4c20e5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.123164 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:38.134506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.135157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.135440 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.135715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] PATH_INFO: `/v3/projects/952082cd079744cc99d3841fcef8ac69` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.136907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952082cd079744cc99d3841fcef8ac69)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.138816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.188476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952082cd079744cc99d3841fcef8ac69', 'request_id': 'req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:38.194775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952082cd079744cc99d3841fcef8ac69', 'request_id': 'req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:38.202274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952082cd079744cc99d3841fcef8ac69', 'request_id': 'req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:38.213569 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] The token cache is being invalidate because project 952082cd079744cc99d3841fcef8ac69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:38.213852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:38.214517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-5791c0a6-0d0f-466f-bfa1-f7ec7201fd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:38.216025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1309/2602] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:38 2022] DELETE /identity/v3/projects/952082cd079744cc99d3841fcef8ac69 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:38.221459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892113-3525-4c09-a326-788c59f3395a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.221934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892113-3525-4c09-a326-788c59f3395a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.222033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e892113-3525-4c09-a326-788c59f3395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.242062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9e892113-3525-4c09-a326-788c59f3395a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:38.243770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e892113-3525-4c09-a326-788c59f3395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:38.307006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1294/2603] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:38.370616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.370929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.371148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.392850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:38.394060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:38.402354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1310/2604] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:38.406696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e892113-3525-4c09-a326-788c59f3395a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.416688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e892113-3525-4c09-a326-788c59f3395a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.421352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.422012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.422340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.422612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.423254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:38.423555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.425142 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.439371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1295/2605] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:54:38.443405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.452850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd00b9-8deb-41c2-b28b-14a1d9bcffb1 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.458116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.458726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.459005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.459277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.461274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.462775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.490352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1311/2606] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:38.494814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.505849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598b23c-7eaf-4bd8-b2e0-252c6ee5e0e9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.572163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.572771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.573049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.573322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.573952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.575932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.592632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:38.601120 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1296/2607] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:38 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:38.605383 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.616132 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adbe92-3155-44e3-be8d-7edac095f3ab admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.621449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.622050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.622358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.622626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.623263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.624847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.635784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1312/2608] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:38.640139 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.651542 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb777e-a882-4b9d-9222-29c53e96a644 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.656518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.656930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.657215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.657491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.658177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.659784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da343-5938-4cce-aa8b-b909cf1fc1ae admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.670769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1297/2609] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:38.675172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.685405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f8a90-0679-48b0-8a85-e130b3a9bd72 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.690618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.691265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.691540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.691811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] PATH_INFO: `/v3/projects/51bb4e28652743b8a358cca1a5c03f8a/users/2883558b2ad54183afa1b07032ea1e6f/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.707946 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bb4e28652743b8a358cca1a5c03f8a, user_id=2883558b2ad54183afa1b07032ea1e6f, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.710613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.723989 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1313/2610] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:38 2022] PUT /identity/v3/projects/51bb4e28652743b8a358cca1a5c03f8a/users/2883558b2ad54183afa1b07032ea1e6f/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:38.729022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af63e7-5eed-431e-b0b3-ed0cd0b20889 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.729309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af63e7-5eed-431e-b0b3-ed0cd0b20889 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.729636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af63e7-5eed-431e-b0b3-ed0cd0b20889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.749351 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f5af63e7-5eed-431e-b0b3-ed0cd0b20889 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:38.751249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f5af63e7-5eed-431e-b0b3-ed0cd0b20889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:38.811022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1298/2611] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:38.821492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:38.823802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:38.884147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34da2-c8e0-43bb-a034-65a721194635 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:38.887878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:38.888491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:38.888769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:38.889041 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:38.898477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:38.899878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:38.909590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1314/2612] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:39.576528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:39.577044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:39.577143 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:39.607346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] MFA Rules not processed for user `2883558b2ad54183afa1b07032ea1e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:39.608598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:39.679589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1299/2613] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:39.684477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:39.694559 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6addf0-3437-44eb-98eb-fee377aec53a service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:39.699121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:39.699742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:39.700017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:39.700289 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:39.700920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:39.702953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:39.725858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:39.739357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1315/2614] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:39 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:39.741065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:39.753582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdfdca-e779-4e6d-9145-4492ff56423d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:39.812628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:39.813244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:39.813528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:39.813808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:39.814483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:39.816420 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:39.845309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1300/2615] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:39 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:39.849815 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:39.865170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7343-8642-485d-b495-2f843ff22676 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:39.870389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:39.871003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:39.871281 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:39.871551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:39.872201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:39.873843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:39.887303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1316/2616] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:39.892124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:39.902781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fb1f3-cb84-43b8-9c0f-4c1e5940997d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:39.907688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:39.908427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:39.908734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:39.909082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] PATH_INFO: `/v3/projects/69d8e6340ad94377994e550db47196f7/users/4616c79fb18d41169ddb4a69e64bf49e/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:39.911700 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:39.928779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d8e6340ad94377994e550db47196f7, user_id=4616c79fb18d41169ddb4a69e64bf49e, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:39.931536 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:39.946800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1301/2617] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:39 2022] PUT /identity/v3/projects/69d8e6340ad94377994e550db47196f7/users/4616c79fb18d41169ddb4a69e64bf49e/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:39.950904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:39.962602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3f057-c42e-4891-83a6-ea3e43451880 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:40.022634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:40.023235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:40.023510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:40.023776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:40.024406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:40.026003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71a24-8f2d-452a-9453-ad2500037766 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:40.036184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1317/2618] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:40.040412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:40.050674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc8566-93f2-4208-8b22-d8cfa4c86c72 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:40.055191 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:40.055843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:40.056123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:40.056393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] PATH_INFO: `/v3/projects/69d8e6340ad94377994e550db47196f7/users/4616c79fb18d41169ddb4a69e64bf49e/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:40.058313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d8e6340ad94377994e550db47196f7, user_id=4616c79fb18d41169ddb4a69e64bf49e, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:40.060929 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948aecd-48e5-48e5-b77c-de38aa03e299 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:40.077216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1302/2619] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:40 2022] PUT /identity/v3/projects/69d8e6340ad94377994e550db47196f7/users/4616c79fb18d41169ddb4a69e64bf49e/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:40.773343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:40.773889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:40.774405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:40.806803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] MFA Rules not processed for user `4616c79fb18d41169ddb4a69e64bf49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:40.808148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:40.886419 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1318/2620] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:40.897023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:40.897593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:40.897593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:40.918892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] MFA Rules not processed for user `2883558b2ad54183afa1b07032ea1e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:40.920221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:40.980336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1303/2621] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:40.994716 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:40.996470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:41.072671 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe962d7-5d68-41db-9d02-6a72bf90e01f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:41.079206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:41.079830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:41.080203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:41.080371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:41.085394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:41.089800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:41.091791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:41.102247 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1319/2622] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:41.340433 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:41.341881 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:41.408451 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45736f-375b-44be-8894-062e5d47caaf None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:41.412087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:41.412696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:41.413022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:41.413320 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:41.415738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:41.428130 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:41.429595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:41.438438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1304/2623] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:43.048964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:43.050950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:43.131954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9309-27e4-48c4-86a8-41daf39379e3 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:43.138139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:43.138771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:43.139052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:43.139318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:43.143792 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:43.160747 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:43.163676 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:43.184378 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1320/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:48.837943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:48.860608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834621-f1f4-4582-8514-a11c25a94c38 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:48.866707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:48.867221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:48.867496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:48.867777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:48.869729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:48.883149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:48.884795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:48.896309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1305/2625] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:53.175827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=35 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:54.861801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:54.885479 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0670f-302c-4b1d-aa7e-414c566589a9 service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:54.900809 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:54.902348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:54.903080 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:54.904006 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:54.907780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:54.933805 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:54.943837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8bfba-8bc3-41b1-8738-9fa91fed8c69 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:54.958042 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1321/2626] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:55.014128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:55.016217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:55.106336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8d3b-5f70-473c-801d-a1fbe9f9c862 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:55.114914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:55.115639 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:55.115972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:55.116324 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] PATH_INFO: `/v3/users/facd5a482f2b4223a0171aa1a9f2d99a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:55.117931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=facd5a482f2b4223a0171aa1a9f2d99a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:55.120628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:55.127209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:55.192733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facd5a482f2b4223a0171aa1a9f2d99a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.201201 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facd5a482f2b4223a0171aa1a9f2d99a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.217083 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facd5a482f2b4223a0171aa1a9f2d99a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.217970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facd5a482f2b4223a0171aa1a9f2d99a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.227443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facd5a482f2b4223a0171aa1a9f2d99a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.235964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1306/2627] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:55 2022] DELETE /identity/v3/users/facd5a482f2b4223a0171aa1a9f2d99a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:55.240841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:55.241260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:55.242098 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:55.266675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:55.267932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:55.345655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1322/2628] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:55.356200 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:55.358160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:55.421326 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31393433-5da0-4809-9c26-ce554c31d0b9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:55.425780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:55.426438 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:55.426723 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:55.426989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:55.437283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:55.439501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:55.451233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1307/2629] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:55.759437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:55.761327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:55.778225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559c573-4047-4d0c-bdb1-184f66a67524 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:55.786206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:55.787276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:55.787767 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:55.788254 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] PATH_INFO: `/v3/projects/6bcfb643874b4545b7db06ed6697965b` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:55.790404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bcfb643874b4545b7db06ed6697965b)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:55.793487 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:55.866333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcfb643874b4545b7db06ed6697965b', 'request_id': 'req-066f951a-5c12-4f30-9e0f-30ef402a8360'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.875654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcfb643874b4545b7db06ed6697965b', 'request_id': 'req-066f951a-5c12-4f30-9e0f-30ef402a8360'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.887541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcfb643874b4545b7db06ed6697965b', 'request_id': 'req-066f951a-5c12-4f30-9e0f-30ef402a8360'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.903363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] The token cache is being invalidate because project 6bcfb643874b4545b7db06ed6697965b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:55.903662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.904407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:55.906028 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1323/2630] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:55 2022] DELETE /identity/v3/projects/6bcfb643874b4545b7db06ed6697965b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:55.910571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:55.921321 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa921a2-99d6-42f0-9e81-22268ba23053 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:56.007514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:56.008798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.009577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.009790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] PATH_INFO: `/v3/users/76ef78f82cc048ddb3d7b33849570129` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.012405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ef78f82cc048ddb3d7b33849570129)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:56.016805 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:56.075452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:56.100732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ef78f82cc048ddb3d7b33849570129'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.108690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ef78f82cc048ddb3d7b33849570129'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.122867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ef78f82cc048ddb3d7b33849570129'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.123635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ef78f82cc048ddb3d7b33849570129'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.133418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4590195c-31eb-4697-b6e7-2e934f361900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ef78f82cc048ddb3d7b33849570129'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.140146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1308/2631] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:54:55 2022] DELETE /identity/v3/users/76ef78f82cc048ddb3d7b33849570129 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:56.512695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:56.514628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:56.529588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f951a-5c12-4f30-9e0f-30ef402a8360 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:56.598357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:56.598995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.599304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.599639 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] PATH_INFO: `/v3/projects/e4b8e068abda46b1841bd87003b6e188` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.600796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b8e068abda46b1841bd87003b6e188)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:56.602786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:56.616279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:56.663436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b8e068abda46b1841bd87003b6e188', 'request_id': 'req-969795dc-a710-4014-9425-3015f8fedbac'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.675490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b8e068abda46b1841bd87003b6e188', 'request_id': 'req-969795dc-a710-4014-9425-3015f8fedbac'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.690095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b8e068abda46b1841bd87003b6e188', 'request_id': 'req-969795dc-a710-4014-9425-3015f8fedbac'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.706048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] The token cache is being invalidate because project e4b8e068abda46b1841bd87003b6e188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:54:56.706401 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.707071 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-969795dc-a710-4014-9425-3015f8fedbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:54:56.708674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1324/2632] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:54:56 2022] DELETE /identity/v3/projects/e4b8e068abda46b1841bd87003b6e188 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:56.715813 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.716281 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.716611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.741826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:56.743697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:56.812071 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1309/2633] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:54:56.822776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.823172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.823547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.848975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:56.850565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:56.860166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1325/2634] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:56.864724 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:56.876381 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe2c6-6ab0-4292-aed9-f7c0d7b27cc9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:56.881514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:56.882193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.882481 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.882759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.883427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:54:56.883738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:56.885375 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:56.898654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1310/2635] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:54:56.904182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:56.915984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cb273-4d56-497e-a1bb-8f3873bb8e72 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:56.924329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:56.925330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:56.925794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:56.926292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:56.927442 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:56.931074 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:56.969963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1326/2636] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:56 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:56.976115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:56.987687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb7c17-a987-4f7b-b552-032a708e57b7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.049812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.050673 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.050818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.051002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.051653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.053603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.077665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1311/2637] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:56 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:54:57.084123 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.108726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9728392-236e-40be-8f2e-43511869c5ec admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.123517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.125653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.126789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.127787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.129421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.132653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.152850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1327/2638] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:57.159931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.174418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bdc9d-3918-41d7-aa0e-0dfdd04d86de admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.179222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.180217 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.180456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.180668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.181518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.183390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b876f-97e3-4d70-bf26-c93fd3bd8808 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.197184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1312/2639] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:57.201818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.214958 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6803e0-201d-44a6-9b8b-fb2272189097 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.221308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.221308 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.221783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.221783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] PATH_INFO: `/v3/projects/6f11a74182a7442fa7a1fca91a0aaa43/users/712dab8e61a24ba69eaa7e2fb1a04171/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.243169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f11a74182a7442fa7a1fca91a0aaa43, user_id=712dab8e61a24ba69eaa7e2fb1a04171, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.246939 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.267919 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1328/2640] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:57 2022] PUT /identity/v3/projects/6f11a74182a7442fa7a1fca91a0aaa43/users/712dab8e61a24ba69eaa7e2fb1a04171/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:57.282617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.283118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.283589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.324052 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:57.344816 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] MFA Rules not processed for user `712dab8e61a24ba69eaa7e2fb1a04171`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:57.348305 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:57.466243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1313/2641] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:57.474912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.581745 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f307b60-255d-4eac-acc4-f69796cf81b0 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.593363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.599205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.599205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.599205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.599205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.603789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.658154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1329/2642] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:54:57 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:57.666116 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.687097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041228-c041-4e26-a12a-79ff836cf509 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.831384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.842294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.852388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.852969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.854263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.857734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.892568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1314/2643] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:54:57 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:54:57.896981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.908436 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cb4d8-87bd-4802-87b6-c9ed137cb5d7 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.914522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.915521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.915859 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.916343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.917358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.920043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:57.937192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1330/2644] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:54:57.942912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:57.955460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5565a-ef9b-45a3-a796-a88cf83904bf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:57.960164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:57.960851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:57.961136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:57.961416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] PATH_INFO: `/v3/projects/691effb041fa4868b28674f6e504be05/users/3481f958aec34b25ac9106634d78f7e1/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:57.983978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691effb041fa4868b28674f6e504be05, user_id=3481f958aec34b25ac9106634d78f7e1, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:57.987092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:58.005622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1315/2645] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:57 2022] PUT /identity/v3/projects/691effb041fa4868b28674f6e504be05/users/3481f958aec34b25ac9106634d78f7e1/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:54:58.011146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:58.026309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcaf24-cb71-46c5-bf78-a3cf3e807678 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:58.038306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:58.103728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:58.104338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:58.104612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:58.104881 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:58.105525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:58.107159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb852-384b-4aa9-8bfa-c2703652028f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:58.118417 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1331/2646] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:54:58.122957 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:58.134755 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e888a-3a58-496d-889e-683fab5d75b3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:58.139917 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:58.141406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:58.141741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:58.142061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] PATH_INFO: `/v3/projects/691effb041fa4868b28674f6e504be05/users/3481f958aec34b25ac9106634d78f7e1/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:58.144167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691effb041fa4868b28674f6e504be05, user_id=3481f958aec34b25ac9106634d78f7e1, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:58.147038 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:58.160225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1316/2647] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:54:58 2022] PUT /identity/v3/projects/691effb041fa4868b28674f6e504be05/users/3481f958aec34b25ac9106634d78f7e1/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:54:58.173332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:58.173827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:58.174338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:58.214658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] MFA Rules not processed for user `3481f958aec34b25ac9106634d78f7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:54:58.216019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:58.297704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1332/2648] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:54:58.310767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:58.313299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:58.378445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f110fb-48d7-4eb7-a912-b14c7e87b0b2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:58.382959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:58.383710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:58.384047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:58.384365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:58.392127 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:54:58.399501 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:58.401087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:58.413053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1317/2649] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:54:58.501840 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:58.512776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256de7-f700-44ae-91b5-85dde9461680 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:58.517668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:58.518660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:58.518973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:58.519363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:58.592212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:58.594213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:58.604521 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1333/2650] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:54:59.309597 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:54:59.318686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df51d4-7ccf-4c88-9336-697c1bab2ed7 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:54:59.322463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:54:59.323074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:54:59.323355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:54:59.323627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:54:59.325376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:54:59.433585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:54:59.436405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c079-7a73-4581-ad78-515e522c67f0 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:54:59.456557 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1318/2651] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:55:06.513481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:06.561541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=100 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:06.611346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daea32-bdfd-4391-afe4-d56cd73c90ad service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:06.617032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:06.617790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:06.618103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:06.618397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] PATH_INFO: `/v3/users/712dab8e61a24ba69eaa7e2fb1a04171` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:06.619634 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712dab8e61a24ba69eaa7e2fb1a04171)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:06.621641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:06.687234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712dab8e61a24ba69eaa7e2fb1a04171'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:06.699858 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712dab8e61a24ba69eaa7e2fb1a04171'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:06.708484 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712dab8e61a24ba69eaa7e2fb1a04171'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:06.709226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712dab8e61a24ba69eaa7e2fb1a04171'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:06.716922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712dab8e61a24ba69eaa7e2fb1a04171'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:06.723803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1334/2652] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:06 2022] DELETE /identity/v3/users/712dab8e61a24ba69eaa7e2fb1a04171 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:06.728339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:06.728839 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:06.728941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:06.749603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:06.750864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:06.810258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1319/2653] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:06.820271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:06.821681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:06.895587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d5b93-8fa0-43e3-896a-1f62435cbc90 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:06.900697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:06.900697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:06.900697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:06.902528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:06.911592 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:06.913070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:06.923586 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1335/2654] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:07.393345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:07.395334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:07.408177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1d5ca-6681-48af-abd3-615cbca26e2f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:07.415916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:07.416708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:07.417180 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:07.417548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] PATH_INFO: `/v3/projects/6f11a74182a7442fa7a1fca91a0aaa43` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:07.418862 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f11a74182a7442fa7a1fca91a0aaa43)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:07.420959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:07.478685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f11a74182a7442fa7a1fca91a0aaa43', 'request_id': 'req-6ee8f93d-160e-44b8-9552-786784844320'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.485934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f11a74182a7442fa7a1fca91a0aaa43', 'request_id': 'req-6ee8f93d-160e-44b8-9552-786784844320'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.494877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f11a74182a7442fa7a1fca91a0aaa43', 'request_id': 'req-6ee8f93d-160e-44b8-9552-786784844320'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.506398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] The token cache is being invalidate because project 6f11a74182a7442fa7a1fca91a0aaa43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:07.506693 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.507352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.508880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1320/2655] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:07 2022] DELETE /identity/v3/projects/6f11a74182a7442fa7a1fca91a0aaa43 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:07.513266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:07.523679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74833-e611-4ba3-9d00-2410c8909ca2 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:07.575480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:07.585735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:07.586399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:07.586677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:07.586947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] PATH_INFO: `/v3/users/3481f958aec34b25ac9106634d78f7e1` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:07.588096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3481f958aec34b25ac9106634d78f7e1)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:07.590017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:07.648450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3481f958aec34b25ac9106634d78f7e1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.663102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3481f958aec34b25ac9106634d78f7e1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.673245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3481f958aec34b25ac9106634d78f7e1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.674159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3481f958aec34b25ac9106634d78f7e1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.684810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-3cf2171c-6019-4001-8255-bc2d31b1d9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3481f958aec34b25ac9106634d78f7e1'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:07.702363 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1336/2656] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:07 2022] DELETE /identity/v3/users/3481f958aec34b25ac9106634d78f7e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:08.183571 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:08.188800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:08.206651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8f93d-160e-44b8-9552-786784844320 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:08.230518 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:08.291050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:08.291713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.292035 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.292357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] PATH_INFO: `/v3/projects/691effb041fa4868b28674f6e504be05` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.293546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=691effb041fa4868b28674f6e504be05)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:08.295865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:08.382152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691effb041fa4868b28674f6e504be05', 'request_id': 'req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:08.393642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691effb041fa4868b28674f6e504be05', 'request_id': 'req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:08.420465 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691effb041fa4868b28674f6e504be05', 'request_id': 'req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:08.435125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] The token cache is being invalidate because project 691effb041fa4868b28674f6e504be05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:08.435400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:08.436184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8a4bedb2-c670-4eb6-9000-88b6c625f1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:08.443544 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1321/2657] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:08 2022] DELETE /identity/v3/projects/691effb041fa4868b28674f6e504be05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:08.447447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.450109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.450109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.497306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:08.499731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:08.590924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1337/2658] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:08.599297 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.600573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.600930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.635925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:08.637346 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:08.647078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1322/2659] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:08.652215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:08.664330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64344c2d-fa6e-4f75-9a25-bbe96747a7b9 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:08.671364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:08.671364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.671720 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.672422 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.672920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:08.673230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:08.674995 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:08.697908 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1338/2660] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:55:08.700756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:08.718301 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5c9a3-220e-48d3-b683-b326529eb168 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:08.725343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:08.725978 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.726322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.726590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.727307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:08.729493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:08.801218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1323/2661] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:08 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:08.802475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:08.822477 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df065-8b05-4fbe-8f06-d5b3014e2bc1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:08.939376 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:08.940005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:08.940348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:08.940742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:08.941397 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:08.944178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:08.952626 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:08.986178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1339/2662] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:08 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:08.991972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.012790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb126-38d8-4002-8bfe-beb566209a2f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.020971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.021659 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.021947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.022255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.024068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.026475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.046109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1324/2663] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:09.047863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.059047 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34688-131a-4eee-b61c-7a3295712ab4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.066771 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.067463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.067744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.068049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.068667 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.070357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6289-e6b1-4d48-b577-3f2b3b6679bb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.084816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1340/2664] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:09.089758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.111425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f9e0a-8aa7-41ce-815d-04c6b88dc37d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.121135 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.122356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.122840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.123327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] PATH_INFO: `/v3/projects/54d654645cca41f0a09610dac45cba90/users/88124e8aa481434bb429ead1bea416ab/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.146466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d654645cca41f0a09610dac45cba90, user_id=88124e8aa481434bb429ead1bea416ab, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.149141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.165605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1325/2665] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:09 2022] PUT /identity/v3/projects/54d654645cca41f0a09610dac45cba90/users/88124e8aa481434bb429ead1bea416ab/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:09.178577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.179082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.179505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.218055 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] MFA Rules not processed for user `88124e8aa481434bb429ead1bea416ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:09.219981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:09.326476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1341/2666] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:09.333705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.405453 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:09.440698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8b706-c6c8-4c17-8b2d-bec50b896a83 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.446245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.446883 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.447241 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.447421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.448069 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.450011 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.497289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1326/2667] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:09 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:09.502902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.522744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e6c12-9dff-4f81-ba56-1d51f35e4118 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.626005 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.626736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.626923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.627168 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.627819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.629774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.676486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1342/2668] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:09 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:55:09.681210 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.701292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67551af-0f25-4301-b987-531dae67d886 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.710456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.711595 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.712150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.712746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.713988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.717696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.742925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1327/2669] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:09.744262 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.755577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c0949-150c-4b83-9fce-2aa6f6050288 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.761366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.762371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.762929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.763371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] PATH_INFO: `/v3/projects/d7dd4983e6de41bea302d72e6306b75a/users/8ccddaf195e543afa45b61288d798da7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.783742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dd4983e6de41bea302d72e6306b75a, user_id=8ccddaf195e543afa45b61288d798da7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.787311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.803576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1343/2670] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:09 2022] PUT /identity/v3/projects/d7dd4983e6de41bea302d72e6306b75a/users/8ccddaf195e543afa45b61288d798da7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:09.807362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.823811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617317-b4a8-4cb4-b491-ed962b838c16 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.905334 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.907082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.907364 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.907642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.908306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.910625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c3cd0-d291-461c-b91c-21492afef533 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.923245 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1328/2671] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:09.928075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:09.942573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c723-1950-4acc-aa34-ad17248d5ac6 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:09.948198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:09.948843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.949050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.949329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] PATH_INFO: `/v3/projects/d7dd4983e6de41bea302d72e6306b75a/users/8ccddaf195e543afa45b61288d798da7/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:09.951555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dd4983e6de41bea302d72e6306b75a, user_id=8ccddaf195e543afa45b61288d798da7, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:09.954835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:09.969460 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1344/2672] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:09 2022] PUT /identity/v3/projects/d7dd4983e6de41bea302d72e6306b75a/users/8ccddaf195e543afa45b61288d798da7/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:09.991431 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:09.992204 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:09.992833 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:10.066585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] MFA Rules not processed for user `8ccddaf195e543afa45b61288d798da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:10.069129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:10.192485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1329/2673] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:10.209087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:10.211036 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:10.257406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:10.317276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e657fe-4b82-4ecf-82c2-894daf9e5a52 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:10.322945 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:10.325408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:10.325408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:10.326019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:10.340173 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:10.341907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975dc78-d00c-4459-bec1-024ef2f0f16c service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:10.355909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1345/2674] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:10.407731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:10.485260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:10.530551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bcfb5-cf66-4843-82cd-e774d1793549 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:10.535707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:10.536356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:10.536887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:10.537393 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] PATH_INFO: `/v3/users/88124e8aa481434bb429ead1bea416ab` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:10.538421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88124e8aa481434bb429ead1bea416ab)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:10.540568 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:10.628239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88124e8aa481434bb429ead1bea416ab'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:10.640793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88124e8aa481434bb429ead1bea416ab'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:10.663854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88124e8aa481434bb429ead1bea416ab'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:10.665935 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88124e8aa481434bb429ead1bea416ab'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:10.680677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88124e8aa481434bb429ead1bea416ab'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:10.691948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1330/2675] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:10 2022] DELETE /identity/v3/users/88124e8aa481434bb429ead1bea416ab => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:10.698329 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:10.699575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:10.699575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:10.726172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:10.727430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:10.845429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1346/2676] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:10.856991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:10.858591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:10.951442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2087f-58a9-4481-8669-64205d88bbd8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:10.956864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:10.957851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:10.958185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:10.958505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:10.977777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:10.981007 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:11.000690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1331/2677] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:55:11.354259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:11.355929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:11.387774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e56d3e-ffa7-4dfb-867f-e642609439f4 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:11.400658 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:11.401756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:11.402500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:11.404172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] PATH_INFO: `/v3/projects/54d654645cca41f0a09610dac45cba90` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:11.416356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d654645cca41f0a09610dac45cba90)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:11.419170 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:11.499077 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d654645cca41f0a09610dac45cba90', 'request_id': 'req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.512507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d654645cca41f0a09610dac45cba90', 'request_id': 'req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.526870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d654645cca41f0a09610dac45cba90', 'request_id': 'req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.543581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] The token cache is being invalidate because project 54d654645cca41f0a09610dac45cba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:11.543991 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.544871 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.551136 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1347/2678] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:11 2022] DELETE /identity/v3/projects/54d654645cca41f0a09610dac45cba90 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:11.553316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:11.564744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16d95-c1f4-4771-b87b-6bad8ec013da service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:11.632896 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:11.645370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:11.646468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:11.647401 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:11.648087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] PATH_INFO: `/v3/users/8ccddaf195e543afa45b61288d798da7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:11.650238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccddaf195e543afa45b61288d798da7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:11.653486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:11.740489 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccddaf195e543afa45b61288d798da7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.770714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccddaf195e543afa45b61288d798da7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.804441 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccddaf195e543afa45b61288d798da7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.805615 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccddaf195e543afa45b61288d798da7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.818526 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7750353d-e6de-4f84-9a02-cd02d6c8f767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccddaf195e543afa45b61288d798da7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:11.828984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1332/2679] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:11 2022] DELETE /identity/v3/users/8ccddaf195e543afa45b61288d798da7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:12.204823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:12.206348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:12.224314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02e43a-9a6c-47ca-bb71-45ef8a726d44 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:12.289125 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:12.309643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:12.310472 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.310835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.311179 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] PATH_INFO: `/v3/projects/d7dd4983e6de41bea302d72e6306b75a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.321532 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dd4983e6de41bea302d72e6306b75a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:12.323680 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:12.394895 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dd4983e6de41bea302d72e6306b75a', 'request_id': 'req-71e2242a-06bf-4f82-936d-bf8b924a60f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:12.402885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dd4983e6de41bea302d72e6306b75a', 'request_id': 'req-71e2242a-06bf-4f82-936d-bf8b924a60f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:12.415405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dd4983e6de41bea302d72e6306b75a', 'request_id': 'req-71e2242a-06bf-4f82-936d-bf8b924a60f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:12.433711 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] The token cache is being invalidate because project d7dd4983e6de41bea302d72e6306b75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:12.434002 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:12.434725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-71e2242a-06bf-4f82-936d-bf8b924a60f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:12.436551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1348/2680] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:12 2022] DELETE /identity/v3/projects/d7dd4983e6de41bea302d72e6306b75a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:12.442636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.442898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.444149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.464616 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:12.465952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:12.549017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1333/2681] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:12.557315 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.557605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.558144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.596553 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:12.598029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:12.624944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:12.634229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1349/2682] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:12.643751 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867ccb-34f2-4459-b0a8-e4b2c8b85b04 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:12.651940 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:12.653093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.653650 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.654248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.657240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:12.657240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:12.659675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:12.676936 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1334/2683] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 10:55:12.684313 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:12.702560 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ef86-4978-4b6b-9c9f-e75d7760c3c0 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:12.716431 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:12.717852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.718526 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.719017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.719891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:12.722147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:12.765551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1350/2684] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:12 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:12.769790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:12.781850 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a936-0a6c-4155-bc31-9be3b40a36fe admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:12.889778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:12.890675 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.890971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.891502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.892681 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:12.895272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:12.907971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:12.929402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1335/2685] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:12 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:55:12.935271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:12.947725 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdce4-e99c-4f04-a7ff-314c86b45bcc admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:12.953652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:12.954495 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:12.954869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:12.955239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:12.956587 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:12.961556 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:12.990582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1351/2686] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:12.996970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.010538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d87877-d3d2-4c97-9ff4-46462c26d556 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.015707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.016330 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.016612 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.017033 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.017696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.019362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a3bc6-4f15-48e1-add2-ae8393a032a3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.032743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1336/2687] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:13.036753 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.048499 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117c4-7392-482d-9d5e-9a595e0f81cb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.053354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.054009 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.054395 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.054696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] PATH_INFO: `/v3/projects/6894ae8b529048849add519244937578/users/58b9ebde9b374a0a90ed5431cc742023/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.072624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6894ae8b529048849add519244937578, user_id=58b9ebde9b374a0a90ed5431cc742023, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.075775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7a188-1aba-4619-adf0-cac4989273ee admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.090869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1352/2688] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:13 2022] PUT /identity/v3/projects/6894ae8b529048849add519244937578/users/58b9ebde9b374a0a90ed5431cc742023/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:13.102187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.102479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.102758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.137079 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] MFA Rules not processed for user `58b9ebde9b374a0a90ed5431cc742023`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:13.138353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:13.157675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.158145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.158555 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.181851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] MFA Rules not processed for user `e2350f11b09846d48385a08eb29a95e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:13.183292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:13.212787 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1337/2689] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:13.217238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.243828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1353/2690] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:13.291566 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455d6f0-b53b-48f0-b16c-c87bf994996f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.296182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.297028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.297314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.297588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.298254 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.300291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.334429 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1338/2691] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:13 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:55:13.336101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.348276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57464a4-167b-418c-bcb2-c5843f86fd4d None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.364435 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:13.422516 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.423157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.423432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.423694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.424332 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.426364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.451835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1354/2692] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:13 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:55:13.454008 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.464510 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e816c-ebef-4de5-8bc7-5727645e2b07 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.470625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.471337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.471686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.471962 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.472619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.474248 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.486194 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1339/2693] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:13.490768 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.502032 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10e6a-0050-4627-9b57-bfc55d1130c1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.507326 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.507997 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.508274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.508545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] PATH_INFO: `/v3/projects/9cd2f560e904467a82636cf3cdde1b70/users/a728b20829c340b69305a159bed54e28/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.524692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd2f560e904467a82636cf3cdde1b70, user_id=a728b20829c340b69305a159bed54e28, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.527511 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.544319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1355/2694] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:13 2022] PUT /identity/v3/projects/9cd2f560e904467a82636cf3cdde1b70/users/a728b20829c340b69305a159bed54e28/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:13.548911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.559672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3c85-eea7-43d9-8014-479cc6b0a55e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.612234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:13.627092 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.628043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.628043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.628277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.628895 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.630555 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c120c6-60cc-41d7-aff6-e7ecfc102e25 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.641073 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1340/2695] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:13.645276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.655797 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc84c3-6672-49aa-82d2-8167716b7b8c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.661065 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.661724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.662007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.662314 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] PATH_INFO: `/v3/projects/9cd2f560e904467a82636cf3cdde1b70/users/a728b20829c340b69305a159bed54e28/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.664236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd2f560e904467a82636cf3cdde1b70, user_id=a728b20829c340b69305a159bed54e28, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.667193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:13.679388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1356/2696] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:13 2022] PUT /identity/v3/projects/9cd2f560e904467a82636cf3cdde1b70/users/a728b20829c340b69305a159bed54e28/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:13.749102 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.749378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.749649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.782093 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] MFA Rules not processed for user `a728b20829c340b69305a159bed54e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:13.783655 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:13.881157 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1341/2697] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:13.892764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:13.894869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:13.981367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810774-3104-42f0-9cab-ac219bac9f69 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:13.986627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:13.987269 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:13.987537 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:13.987803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:13.997804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:13.999287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb80a3-f751-4541-b21b-0c45f19e5efc service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:14.010728 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1357/2698] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:14.175403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:14.270192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271203fe-73d2-4c95-8926-2fc46e609ae1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:14.276892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:14.277640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:14.278022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:14.278396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] PATH_INFO: `/v3/users/58b9ebde9b374a0a90ed5431cc742023` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:14.281421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b9ebde9b374a0a90ed5431cc742023)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:14.284260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:14.370193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b9ebde9b374a0a90ed5431cc742023'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:14.422758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b9ebde9b374a0a90ed5431cc742023'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:14.437685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:14.443998 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b9ebde9b374a0a90ed5431cc742023'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:14.444878 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b9ebde9b374a0a90ed5431cc742023'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:14.456651 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b9ebde9b374a0a90ed5431cc742023'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:14.465806 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1342/2699] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:14 2022] DELETE /identity/v3/users/58b9ebde9b374a0a90ed5431cc742023 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:14.472408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:14.472988 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:14.473321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:14.503589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:14.505630 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:14.591818 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1358/2700] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:14.604979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:14.610531 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:14.707861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970984-45fc-4997-95bc-df17ec65f928 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:14.713263 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:14.714017 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:14.714546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:14.714995 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:14.728691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:14.730837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:14.749547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1343/2701] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:15.154437 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:15.156796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:15.176722 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fbe67-2ade-4b0b-a334-4e6718557d1f None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:15.186841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:15.188752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:15.189421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:15.189896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] PATH_INFO: `/v3/projects/6894ae8b529048849add519244937578` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:15.191647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6894ae8b529048849add519244937578)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:15.194316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:15.204825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:15.249310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6894ae8b529048849add519244937578', 'request_id': 'req-185a7a5b-5129-4fc1-bbd1-58c5adac8037'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.256929 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6894ae8b529048849add519244937578', 'request_id': 'req-185a7a5b-5129-4fc1-bbd1-58c5adac8037'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.267253 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6894ae8b529048849add519244937578', 'request_id': 'req-185a7a5b-5129-4fc1-bbd1-58c5adac8037'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.279610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] The token cache is being invalidate because project 6894ae8b529048849add519244937578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:15.279897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.280849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.282475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1359/2702] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:15 2022] DELETE /identity/v3/projects/6894ae8b529048849add519244937578 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:15.286759 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:15.296869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b258-b0cc-4908-b63e-73beda2e0746 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:15.355002 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:15.355966 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:15.356316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:15.356632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] PATH_INFO: `/v3/users/a728b20829c340b69305a159bed54e28` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:15.358108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a728b20829c340b69305a159bed54e28)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:15.360239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:15.428355 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a728b20829c340b69305a159bed54e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.439539 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a728b20829c340b69305a159bed54e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.462356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a728b20829c340b69305a159bed54e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.463447 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a728b20829c340b69305a159bed54e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.488828 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-625ec84d-dd7a-426f-b9cd-e123e53dbd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a728b20829c340b69305a159bed54e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:15.506682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1344/2703] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:15 2022] DELETE /identity/v3/users/a728b20829c340b69305a159bed54e28 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:16.166894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:16.168496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:16.190533 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7a5b-5129-4fc1-bbd1-58c5adac8037 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:16.266709 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:16.267804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.268294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.268756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] PATH_INFO: `/v3/projects/9cd2f560e904467a82636cf3cdde1b70` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.270420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd2f560e904467a82636cf3cdde1b70)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:16.273052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:16.350570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd2f560e904467a82636cf3cdde1b70', 'request_id': 'req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:16.360366 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd2f560e904467a82636cf3cdde1b70', 'request_id': 'req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:16.372547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd2f560e904467a82636cf3cdde1b70', 'request_id': 'req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:16.396411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] The token cache is being invalidate because project 9cd2f560e904467a82636cf3cdde1b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:16.397282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:16.398338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-e97102fb-6fdb-461d-8b6a-e3ff83f156f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:16.400571 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1360/2704] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:16 2022] DELETE /identity/v3/projects/9cd2f560e904467a82636cf3cdde1b70 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:16.408141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.410165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.410770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.439520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:16.441131 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:16.446187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:16.532648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1345/2705] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:16.540458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.540816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.541159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.568848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:16.570470 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:16.581802 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1361/2706] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:16.587283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:16.605386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0d586-ee72-4e57-81d2-2e6fdaad0cde None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:16.614388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:16.615793 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.616654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.617756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.618939 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:16.619435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:16.622394 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:16.648335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1346/2707] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:55:16.655105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:16.674506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bca36-de56-4fa6-83d4-bfe13c36affb None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:16.683352 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:16.684486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.685043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.685528 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.686828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:16.690674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:16.726904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:16.741210 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1362/2708] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:16 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:16.743482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:16.759300 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d871ef3-06fd-48d9-a517-6ebeaed7168e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:16.870090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:16.872873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.873340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.874014 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.875432 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:16.879005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:16.929235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1347/2709] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:16 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:16.933962 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:16.947213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d618d-f889-4e43-9860-a6bbf33b080c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:16.953305 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:16.953992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:16.954325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:16.954590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:16.955279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:16.957182 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:16.977882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1363/2710] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:16.979605 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:17.001692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaebad-c4e0-4647-8617-12b5617ed878 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:17.019519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:17.020894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:17.021419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:17.021911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:17.023575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:17.026642 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba706c-b3ad-4508-9fe7-42575815e247 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:17.058893 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1348/2711] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:17.060050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:17.074953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f3cad-a491-47c3-857a-90ba6c702b2c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:17.082350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:17.083034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:17.083311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:17.083584 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] PATH_INFO: `/v3/projects/6f359460bb10472cb9a6da0bbd7ab5f9/users/e933f8d6e034471883f52c7a40f98e3c/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:17.102160 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f359460bb10472cb9a6da0bbd7ab5f9, user_id=e933f8d6e034471883f52c7a40f98e3c, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:17.105185 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:17.150351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1364/2712] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:17 2022] PUT /identity/v3/projects/6f359460bb10472cb9a6da0bbd7ab5f9/users/e933f8d6e034471883f52c7a40f98e3c/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:17.161684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:17.162511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:17.163482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:17.215003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] MFA Rules not processed for user `e933f8d6e034471883f52c7a40f98e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:17.216445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:17.358115 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1349/2713] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:17.376068 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:17.378920 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:17.535524 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fb98a-2ec6-4999-8062-afe5d50ef24a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:17.542190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c648572b085545719bd8b6f1dcdf1a85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:17.543387 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:17.543775 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:17.544273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:17.565139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:17.570256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:17.583066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1365/2714] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:21.761686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:21.764178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:21.777486 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:21.894163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8fc27-60e4-4b80-ab4f-60007b2935ff None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:21.899583 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:21.900259 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:21.900556 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:21.900831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] PATH_INFO: `/v3/users/2883558b2ad54183afa1b07032ea1e6f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:21.902019 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2883558b2ad54183afa1b07032ea1e6f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:21.904036 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:21.969247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2883558b2ad54183afa1b07032ea1e6f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:21.980119 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2883558b2ad54183afa1b07032ea1e6f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.003772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2883558b2ad54183afa1b07032ea1e6f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.004443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2883558b2ad54183afa1b07032ea1e6f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.015039 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2883558b2ad54183afa1b07032ea1e6f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.021969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1350/2715] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:21 2022] DELETE /identity/v3/users/2883558b2ad54183afa1b07032ea1e6f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:22.228611 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:22.254963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0f8cd-a6fc-4bb2-b0b0-4cb08f782a18 service glance] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:22.333235 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:22.334550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:22.334992 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:22.335396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] PATH_INFO: `/v3/projects/51bb4e28652743b8a358cca1a5c03f8a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:22.337955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bb4e28652743b8a358cca1a5c03f8a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:22.339650 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:22.411942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:22.413736 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bb4e28652743b8a358cca1a5c03f8a', 'request_id': 'req-1ac6b897-ff0a-4409-9630-b424e19db699'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.426239 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bb4e28652743b8a358cca1a5c03f8a', 'request_id': 'req-1ac6b897-ff0a-4409-9630-b424e19db699'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.435046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bb4e28652743b8a358cca1a5c03f8a', 'request_id': 'req-1ac6b897-ff0a-4409-9630-b424e19db699'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.447195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] The token cache is being invalidate because project 51bb4e28652743b8a358cca1a5c03f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:22.447482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.448141 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.450693 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1366/2716] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:22 2022] DELETE /identity/v3/projects/51bb4e28652743b8a358cca1a5c03f8a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:22.458577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:22.460851 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:22.482274 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9f8f-caba-4245-83b1-c897ade4961b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:22.555954 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:22.557442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:22.557898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:22.558382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] PATH_INFO: `/v3/users/4616c79fb18d41169ddb4a69e64bf49e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:22.560074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4616c79fb18d41169ddb4a69e64bf49e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:22.563426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:22.609440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:22.654302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4616c79fb18d41169ddb4a69e64bf49e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.662777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4616c79fb18d41169ddb4a69e64bf49e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.676023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4616c79fb18d41169ddb4a69e64bf49e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.677546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4616c79fb18d41169ddb4a69e64bf49e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.692780 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-0695aa67-9075-47e0-adc8-f996cb943482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4616c79fb18d41169ddb4a69e64bf49e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:22.700046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1351/2717] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:22 2022] DELETE /identity/v3/users/4616c79fb18d41169ddb4a69e64bf49e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:22.928543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:22.930438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:22.950371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6b897-ff0a-4409-9630-b424e19db699 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.059925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.061084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.061609 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.062225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] PATH_INFO: `/v3/projects/69d8e6340ad94377994e550db47196f7` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.064172 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d8e6340ad94377994e550db47196f7)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.067769 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.158909 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d8e6340ad94377994e550db47196f7', 'request_id': 'req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:23.170757 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d8e6340ad94377994e550db47196f7', 'request_id': 'req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:23.182274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d8e6340ad94377994e550db47196f7', 'request_id': 'req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:23.197121 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] The token cache is being invalidate because project 69d8e6340ad94377994e550db47196f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:23.197393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:23.198148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ac8b7375-e47b-43ee-8d99-4a1ee19149f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:23.200122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1367/2718] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:22 2022] DELETE /identity/v3/projects/69d8e6340ad94377994e550db47196f7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:23.210347 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.210798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.211302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.239249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:23.241491 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:23.321094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1352/2719] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:23.330647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.331213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.331213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.356118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:23.358221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:23.376094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1368/2720] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:23.377589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.388001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf527b0-2fa3-4657-b325-7dfa9e43e0ae None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.393577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.394232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.394514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.394786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.395446 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:23.395753 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.397356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.411999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1353/2721] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:55:23.417817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.432236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b037700-e5c6-41ed-90d1-852a05927b8c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.438333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.438984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.439257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.439518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.440189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.442202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.478153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1369/2722] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:23 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:23.483084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.496385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd991ca-d2dc-43df-bd50-b251859f91f0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.570455 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.571077 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.571418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.571653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.572290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.574404 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.600342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1354/2723] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:23 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:23.604956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.619241 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719816f7-059e-4eaf-b076-69d9a89599bb admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.624333 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.625506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.625777 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.626045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.626743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.628371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.645544 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1370/2724] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:23.649630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.661508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9639-98f4-4a3a-8d30-71bd78775775 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.667288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.668309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.668838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.669316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.674739 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.678738 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039847e-66a8-4a65-9f96-2957d2cfcaf1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.715541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1355/2725] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:23.721023 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.735836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466238f8-f080-47f5-8c0b-136dd2aca422 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:23.742183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:23.743060 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.743447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.744861 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] PATH_INFO: `/v3/projects/9bf631589a8b436db2934df5af89f7d3/users/b7a691f9d7874b75b689d7913dae5516/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.770446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf631589a8b436db2934df5af89f7d3, user_id=b7a691f9d7874b75b689d7913dae5516, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:23.775804 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:23.802677 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1371/2726] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:23 2022] PUT /identity/v3/projects/9bf631589a8b436db2934df5af89f7d3/users/b7a691f9d7874b75b689d7913dae5516/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:23.823343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:23.823581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:23.823800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:23.846356 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:23.861474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] MFA Rules not processed for user `b7a691f9d7874b75b689d7913dae5516`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:23.862758 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:23.940043 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1356/2727] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:23.952795 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:23.957483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:23.967310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:24.034257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7de20-ea79-4c77-8558-6aad6b9abad9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:24.038642 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:24.039266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:24.039540 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:24.039810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:24.049092 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:24.050594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31393-553c-485f-b5bd-8feedfef52b8 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:24.061016 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1372/2728] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:55:24.088554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:24.177837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530fa98-c6d6-4a5f-911b-cea1f553f8fe None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:24.185617 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:24.186317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:24.186598 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:24.186884 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] PATH_INFO: `/v3/users/b7a691f9d7874b75b689d7913dae5516` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:24.188618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a691f9d7874b75b689d7913dae5516)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:24.190590 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:24.250512 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a691f9d7874b75b689d7913dae5516'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:24.259296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a691f9d7874b75b689d7913dae5516'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:24.272581 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a691f9d7874b75b689d7913dae5516'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:24.273336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a691f9d7874b75b689d7913dae5516'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:24.284871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a691f9d7874b75b689d7913dae5516'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:24.294636 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1357/2729] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:24 2022] DELETE /identity/v3/users/b7a691f9d7874b75b689d7913dae5516 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:24.301303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:24.302316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:24.302847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:24.332562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:24.334238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:24.420050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1373/2730] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:24.428174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:24.429932 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:24.456722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:24.515490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96f7c7-9b7b-458a-905d-15a4c76d4671 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:24.519350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:24.519991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:24.520293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:24.520565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:24.533390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:24.534863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:24.546012 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1358/2731] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:24.902803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:24.904307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:24.923488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696cc13-d1d3-4e95-8eac-49fc182d2d03 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:24.928377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:24.929024 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:24.929303 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:24.929573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] PATH_INFO: `/v3/projects/9bf631589a8b436db2934df5af89f7d3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:24.930760 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf631589a8b436db2934df5af89f7d3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:24.932703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:25.009813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf631589a8b436db2934df5af89f7d3', 'request_id': 'req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:25.018219 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf631589a8b436db2934df5af89f7d3', 'request_id': 'req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:25.032665 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf631589a8b436db2934df5af89f7d3', 'request_id': 'req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:25.046507 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] The token cache is being invalidate because project 9bf631589a8b436db2934df5af89f7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:25.047474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:25.048221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:25.050794 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1374/2732] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:24 2022] DELETE /identity/v3/projects/9bf631589a8b436db2934df5af89f7d3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:29.391313 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:29.393138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:29.499548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d576b75-ade3-4d84-8d91-aacffdb43276 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:29.714922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:29.715923 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:29.716251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:29.716524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:29.719916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:29.732804 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:29.735287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc241f-5594-443b-a6b6-d876cf533360 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:29.750214 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1359/2733] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:35.042823 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:39.742971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=80 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:46.127655 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.129089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.195454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06bca-ad87-44b1-ab41-51ef0e07f85f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:46.200368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:46.200905 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.201181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.201450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] PATH_INFO: `/v3/users/e933f8d6e034471883f52c7a40f98e3c` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.202608 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e933f8d6e034471883f52c7a40f98e3c)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:46.204551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:46.258788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e933f8d6e034471883f52c7a40f98e3c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.275595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e933f8d6e034471883f52c7a40f98e3c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.283061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e933f8d6e034471883f52c7a40f98e3c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.283781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e933f8d6e034471883f52c7a40f98e3c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.291811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e933f8d6e034471883f52c7a40f98e3c'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.298110 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1375/2734] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:46 2022] DELETE /identity/v3/users/e933f8d6e034471883f52c7a40f98e3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:46.302654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.303170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.303276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.333105 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:46.335196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.421735 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1360/2735] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:46.431955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.433377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.497855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081031b-83be-4e39-8a79-0c314351e8bd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:46.501721 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:46.502379 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.502657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.502924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.513094 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:46.514604 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8c11b-46d0-4b4d-b83a-98d24174d7dc service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:46.526896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1376/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:46.845427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:46.847445 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.863238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddce9a-394a-4692-b413-0cd771b51974 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:46.869836 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:46.870968 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.871426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.871922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] PATH_INFO: `/v3/projects/6f359460bb10472cb9a6da0bbd7ab5f9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.873608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f359460bb10472cb9a6da0bbd7ab5f9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:46.876325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:46.924589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f359460bb10472cb9a6da0bbd7ab5f9', 'request_id': 'req-6faf7583-1b41-43b2-a062-56925e470999'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.930808 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f359460bb10472cb9a6da0bbd7ab5f9', 'request_id': 'req-6faf7583-1b41-43b2-a062-56925e470999'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.941098 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f359460bb10472cb9a6da0bbd7ab5f9', 'request_id': 'req-6faf7583-1b41-43b2-a062-56925e470999'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.951892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] The token cache is being invalidate because project 6f359460bb10472cb9a6da0bbd7ab5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:46.952133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.952757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6faf7583-1b41-43b2-a062-56925e470999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:46.954818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1361/2737] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:46 2022] DELETE /identity/v3/projects/6f359460bb10472cb9a6da0bbd7ab5f9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:55:46.959694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:46.959971 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:46.960259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:46.979866 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:46.981076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:46.999307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:47.045372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1377/2738] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:47.053697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.053983 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.054325 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.074369 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:47.075584 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:47.083599 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1362/2739] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:47.087994 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.097723 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381baf7-ee4a-4603-82a1-61a04e6ca0ab None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.102284 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.102874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.103147 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.103412 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.104054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:55:47.104350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.105936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.118803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1378/2740] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:55:47.123196 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.133165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211fb6c-9894-474f-9452-2a94d060a746 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.137786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.138425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.138708 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.138982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.139626 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.141523 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.169090 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1363/2741] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:55:47 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:47.173748 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.184380 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1100-56a7-4735-89f8-ead73684bd2f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.247812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.248349 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.248632 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.248902 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.249564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.252227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.274370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1379/2742] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:55:47 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:55:47.278482 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.288977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c7419-13a4-48b0-bf32-75cc047e5569 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.293582 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.294229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.294505 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.294777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.295421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.297522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.307956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1364/2743] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:55:47.312272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.323307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55839614-130b-4991-bff2-aaf74d767baa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.328404 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.329048 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.329330 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.329662 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.330443 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.332288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25323-7364-41d3-9d58-a1a6cf1ecc4b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.343287 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1380/2744] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:55:47.348058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.358129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11fd4-ddc6-4753-a4b9-aad89a7e5b4f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.363312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.363964 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.364244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.364516 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] PATH_INFO: `/v3/projects/56aa21ad205945f2bb9e06aecc4e8025/users/d3413f604d7544229ef111122e0453d9/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.380992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aa21ad205945f2bb9e06aecc4e8025, user_id=d3413f604d7544229ef111122e0453d9, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.386316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.401553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1365/2745] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:55:47 2022] PUT /identity/v3/projects/56aa21ad205945f2bb9e06aecc4e8025/users/d3413f604d7544229ef111122e0453d9/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:47.412708 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.413018 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.413294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.444589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] MFA Rules not processed for user `d3413f604d7544229ef111122e0453d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:47.445865 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:47.539382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1381/2746] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:55:47.557551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:47.560405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:47.592133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:47.631912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b8b15-a8b9-4727-8718-3549d03b6ab8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:47.635585 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:47.636193 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:47.636466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:47.636734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:47.645541 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:47.646979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25185a-bd95-4836-886e-553c6790ae81 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:47.656838 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1366/2747] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:57.535735 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:57.651882 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=17 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:55:57.917426 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:57.981956 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e583b-43bf-4a98-b21a-c483579c29d6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:57.986531 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:57.987158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:57.987432 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:57.987699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] PATH_INFO: `/v3/users/d3413f604d7544229ef111122e0453d9` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:57.988813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3413f604d7544229ef111122e0453d9)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:57.990780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:58.040078 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3413f604d7544229ef111122e0453d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.052706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3413f604d7544229ef111122e0453d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.059816 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3413f604d7544229ef111122e0453d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.060582 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3413f604d7544229ef111122e0453d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.069384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3413f604d7544229ef111122e0453d9'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.075624 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1382/2748] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:55:57 2022] DELETE /identity/v3/users/d3413f604d7544229ef111122e0453d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:55:58.080821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:58.081109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:58.081382 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:58.099996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:55:58.101106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:58.161124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1367/2749] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:55:58.171265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:58.172705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:58.238362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67b60e-7924-4c37-bf8e-72531b53a4f4 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:58.242087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:58.242955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:58.243227 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:58.243493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:58.253811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:58.255453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:58.266738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1383/2750] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:55:58.541837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:55:58.543391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:55:58.556418 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee846fe-d83f-48cf-a30e-2ae310976bcb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:55:58.561150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:55:58.562006 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:55:58.562931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:55:58.563276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] PATH_INFO: `/v3/projects/56aa21ad205945f2bb9e06aecc4e8025` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:55:58.564474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aa21ad205945f2bb9e06aecc4e8025)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:55:58.566514 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:55:58.616546 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aa21ad205945f2bb9e06aecc4e8025', 'request_id': 'req-245ee064-6aef-4ad4-a868-97953e959676'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.622869 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aa21ad205945f2bb9e06aecc4e8025', 'request_id': 'req-245ee064-6aef-4ad4-a868-97953e959676'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.630331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aa21ad205945f2bb9e06aecc4e8025', 'request_id': 'req-245ee064-6aef-4ad4-a868-97953e959676'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.641197 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] The token cache is being invalidate because project 56aa21ad205945f2bb9e06aecc4e8025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:55:58.641484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.642138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:55:58.643596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1368/2751] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:55:58 2022] DELETE /identity/v3/projects/56aa21ad205945f2bb9e06aecc4e8025 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:56:08.261835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:08.637509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:44.960043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:44.961867 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:45.040819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61be78-7bb5-46d7-bca9-1916f427e6f7 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:45.103692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:45.104299 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:45.104576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:45.104847 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:45.106692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:45.164927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:45.166552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d05c9-71b4-4e96-8243-196ef8888ed1 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:45.175627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1384/2752] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:54.291414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:54.293159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:54.383846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ee064-6aef-4ad4-a868-97953e959676 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:54.390113 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:54.390812 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:54.391702 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:54.393112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:54.394602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:54.406640 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:54.408666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:54.419952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1369/2753] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:56:55.171548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=84 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:56:57.308197 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:57.308927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:57.308927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:57.328342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] MFA Rules not processed for user `e2350f11b09846d48385a08eb29a95e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:56:57.329581 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:57.336843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1385/2754] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:56:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:56:57.651985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:56:57.653497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:57.712256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c862b-455d-4701-b127-a5218d2eb8f7 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:56:57.715925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:56:57.716550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:56:57.716831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:56:57.717106 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:56:57.718925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:56:57.729792 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:56:57.731270 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:56:57.739406 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1370/2755] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:56:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:57:07.322561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:57:07.735770 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=58 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:26.189841 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:26.191310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:26.247782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b84b-a454-4232-a520-2ce13ca6b62c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:26.252089 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:26.252685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:26.252959 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:26.253225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:26.254986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:26.268177 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:26.269589 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:26.280744 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1386/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:28.895323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:28.904784 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d529ee-bc99-417f-8332-abadcd9b5f2f service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:28.908403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:28.908996 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:28.909275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:28.909545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:28.911327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:28.924428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:28.925826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:28.936517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1371/2757] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:36.275787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=26 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:38.931774 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:39.394800 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:39.396229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:39.408345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb666c-15a8-44fb-834b-353faef3d5e2 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:39.411924 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:39.412518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:39.412793 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:39.413061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:39.414783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:39.480621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:39.482053 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:39.492884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1387/2758] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:42.687479 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:42.688949 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:42.703371 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a61ca-2569-468e-9f8c-76f74509edbb service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:42.708533 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:42.709261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:42.709535 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:42.709811 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] PATH_INFO: `/v3/users/e2350f11b09846d48385a08eb29a95e6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:42.715178 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2350f11b09846d48385a08eb29a95e6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:42.717138 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:42.783107 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2350f11b09846d48385a08eb29a95e6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:42.790874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2350f11b09846d48385a08eb29a95e6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:42.804594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2350f11b09846d48385a08eb29a95e6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:42.805337 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2350f11b09846d48385a08eb29a95e6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:42.813802 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-58df9d61-ea80-4d5e-8e5f-1f40444c4f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2350f11b09846d48385a08eb29a95e6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:42.820498 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1372/2759] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:42 2022] DELETE /identity/v3/users/e2350f11b09846d48385a08eb29a95e6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:43.214766 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.231195 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e369fa-41c0-4cb8-b640-fdcadab14ab3 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.296791 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.297425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.297703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.297969 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] PATH_INFO: `/v3/projects/3aa206130c9e4f2496da3a5ee2ece4cd` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.299122 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa206130c9e4f2496da3a5ee2ece4cd)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.301057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.350238 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa206130c9e4f2496da3a5ee2ece4cd', 'request_id': 'req-d965c449-35f1-477b-b1cf-0d0e40a539e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:43.356543 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa206130c9e4f2496da3a5ee2ece4cd', 'request_id': 'req-d965c449-35f1-477b-b1cf-0d0e40a539e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:43.364801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa206130c9e4f2496da3a5ee2ece4cd', 'request_id': 'req-d965c449-35f1-477b-b1cf-0d0e40a539e7'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:43.376396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] The token cache is being invalidate because project 3aa206130c9e4f2496da3a5ee2ece4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:43.376683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:43.377338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d965c449-35f1-477b-b1cf-0d0e40a539e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:43.378923 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1388/2760] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:43 2022] DELETE /identity/v3/projects/3aa206130c9e4f2496da3a5ee2ece4cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:43.384419 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.384692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.384969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.404694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:43.405930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:43.464988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1373/2761] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:43.472879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9363-2836-44d5-a776-a07472917c88 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.473158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9363-2836-44d5-a776-a07472917c88 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.473427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e9363-2836-44d5-a776-a07472917c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.494159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-291e9363-2836-44d5-a776-a07472917c88 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:43.495399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-291e9363-2836-44d5-a776-a07472917c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:43.504181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1389/2762] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:43.508633 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.518873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eacfe-67bf-4335-9620-18dbedfa72a6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.523456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.524070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.524345 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.524614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.525260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:58:43.525559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.527172 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.539247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1374/2763] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:58:43.543763 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e9363-2836-44d5-a776-a07472917c88 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.553687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e9363-2836-44d5-a776-a07472917c88 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.558455 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.559050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.559328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.559595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.560229 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.562784 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.578950 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:43.596536 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1390/2764] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:43 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:43.597671 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.608349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3644cf-3d8e-4f49-ac94-3dde516e6ec2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.665842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.666487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.666766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.667049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.667707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.669593 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.677565 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:43.693485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1375/2765] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:43 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:43.697687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.708894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fef293-a008-4f2d-b5b1-58a144979da1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.713493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.714113 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.714394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.714664 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.715356 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.716896 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.727066 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1391/2766] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:43.731203 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.741511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258c2cc-e324-4d00-b6f7-b06c69a451c4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.746264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.746865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.747144 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.747415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.748112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.750228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ea3e-dbd6-4749-8670-695f77299f19 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.761097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1376/2767] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:43.766220 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.776449 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a571e-bbcb-4b84-ab2a-8785034dda9a admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.781342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.781990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.782306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.782578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] PATH_INFO: `/v3/projects/64fd70b0cbed4d1482279a778c0d88e7/users/d49c06dbbec34c90af74ce5ddf7ba27a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.797267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fd70b0cbed4d1482279a778c0d88e7, user_id=d49c06dbbec34c90af74ce5ddf7ba27a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.799934 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.813616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1392/2768] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:43 2022] PUT /identity/v3/projects/64fd70b0cbed4d1482279a778c0d88e7/users/d49c06dbbec34c90af74ce5ddf7ba27a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:43.818912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13477-2571-445d-b7dd-794d75456b1a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.819228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13477-2571-445d-b7dd-794d75456b1a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.819502 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13477-2571-445d-b7dd-794d75456b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.839463 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dff13477-2571-445d-b7dd-794d75456b1a None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:43.840688 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dff13477-2571-445d-b7dd-794d75456b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:43.899910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1377/2769] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:43.909928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:43.912037 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:43.969951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71ce0-ae49-4b95-ae19-f8a1593bbc8f admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:43.973618 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:43.974231 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:43.974510 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:43.974779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:43.984886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:43.986346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:43.996420 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1393/2770] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:44.614955 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:44.615243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:44.615517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:44.645756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] MFA Rules not processed for user `d49c06dbbec34c90af74ce5ddf7ba27a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:44.646959 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:44.715524 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1378/2771] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:44.720354 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:44.730111 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2adfb-2148-40fa-a87c-ef378d49db31 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:44.735216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:44.735808 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:44.736082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:44.736350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:44.736973 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:44.738953 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:44.769714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1394/2772] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:44 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:44.774686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:44.785704 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd412b-3e25-41eb-807d-d08a55a5a68d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:44.845742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:44.846403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:44.846692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:44.846977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:44.847634 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:44.849560 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:44.866410 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:44.876611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1379/2773] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:44 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:44.877878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:44.888357 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763730f-cd94-444a-8e07-031a8bbcd128 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:44.893003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:44.893598 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:44.893877 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:44.894183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:44.894825 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:44.896407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:44.907486 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1395/2774] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:44.911899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:44.922268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0eb9c-6c12-46e9-b772-079eed513958 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:44.926821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:44.927466 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:44.927746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:44.928027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] PATH_INFO: `/v3/projects/fde6480721bf4973bfd2db89c166beb8/users/d3a6276556784602959c64530042c841/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:44.944055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6480721bf4973bfd2db89c166beb8, user_id=d3a6276556784602959c64530042c841, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:44.946707 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:44.960207 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1380/2775] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:44 2022] PUT /identity/v3/projects/fde6480721bf4973bfd2db89c166beb8/users/d3a6276556784602959c64530042c841/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:44.964198 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:44.974350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a059940-e746-4716-87ed-1222f5631307 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:45.031870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:45.032467 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:45.032746 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:45.033015 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:45.033647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:45.035282 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5c2af-84ac-4e2d-8f84-97a6ca54382e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:45.044927 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1396/2776] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:45.049749 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:45.059941 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697a8e9-19c1-48c5-9c88-5f9b3c451d0a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:45.065089 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:45.065736 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:45.066009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:45.066317 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] PATH_INFO: `/v3/projects/fde6480721bf4973bfd2db89c166beb8/users/d3a6276556784602959c64530042c841/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:45.068187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6480721bf4973bfd2db89c166beb8, user_id=d3a6276556784602959c64530042c841, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:45.070789 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:45.080989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1381/2777] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:45 2022] PUT /identity/v3/projects/fde6480721bf4973bfd2db89c166beb8/users/d3a6276556784602959c64530042c841/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:45.685687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:45.685972 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:45.686297 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:45.717213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] MFA Rules not processed for user `d3a6276556784602959c64530042c841`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:45.719163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:45.735232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:45.796765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1397/2778] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:58:46.257781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:46.259785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:46.352427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78154-0165-4087-88af-0e0db6927027 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:46.357534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:46.358187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:46.358454 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:46.359403 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:46.361187 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:46.373500 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:46.375858 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:46.386396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1382/2779] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:46.839617 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:46.910144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb1913-1d44-48b0-92fc-1eda9851fc23 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:46.915188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:46.915821 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:46.916101 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:46.916372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] PATH_INFO: `/v3/users/d49c06dbbec34c90af74ce5ddf7ba27a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:46.917505 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49c06dbbec34c90af74ce5ddf7ba27a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:46.919458 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:46.968578 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49c06dbbec34c90af74ce5ddf7ba27a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:46.980272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49c06dbbec34c90af74ce5ddf7ba27a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:46.987547 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49c06dbbec34c90af74ce5ddf7ba27a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:46.988230 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49c06dbbec34c90af74ce5ddf7ba27a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:46.995538 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49c06dbbec34c90af74ce5ddf7ba27a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.001892 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1398/2780] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:46 2022] DELETE /identity/v3/users/d49c06dbbec34c90af74ce5ddf7ba27a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:47.173215 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:47.183877 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954b1b-8be3-4d7b-9e55-2b9cf22ed8b6 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:47.241752 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:47.242414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:47.242951 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:47.243221 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] PATH_INFO: `/v3/projects/64fd70b0cbed4d1482279a778c0d88e7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:47.244329 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fd70b0cbed4d1482279a778c0d88e7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:47.246253 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:47.293239 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fd70b0cbed4d1482279a778c0d88e7', 'request_id': 'req-b7ef92d1-ec12-4043-a971-a284278cbe44'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.295224 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:47.300677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fd70b0cbed4d1482279a778c0d88e7', 'request_id': 'req-b7ef92d1-ec12-4043-a971-a284278cbe44'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.308400 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fd70b0cbed4d1482279a778c0d88e7', 'request_id': 'req-b7ef92d1-ec12-4043-a971-a284278cbe44'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.319880 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] The token cache is being invalidate because project 64fd70b0cbed4d1482279a778c0d88e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:47.320154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.320825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.322339 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1383/2781] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:47 2022] DELETE /identity/v3/projects/64fd70b0cbed4d1482279a778c0d88e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:47.326601 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:47.328124 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:47.341503 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a627a-3f04-4fbd-b973-2504f262d351 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:47.371849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:47.400799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:47.401445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:47.401719 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:47.401986 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] PATH_INFO: `/v3/users/d3a6276556784602959c64530042c841` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:47.403142 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a6276556784602959c64530042c841)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:47.405050 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:47.454949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a6276556784602959c64530042c841'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.467199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a6276556784602959c64530042c841'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.474739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a6276556784602959c64530042c841'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.475475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a6276556784602959c64530042c841'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.483434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-bba645c0-9d15-4ec6-9fcf-79ac3291154c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a6276556784602959c64530042c841'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.490319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1399/2782] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:47 2022] DELETE /identity/v3/users/d3a6276556784602959c64530042c841 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:47.678848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:47.680331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:47.693576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef92d1-ec12-4043-a971-a284278cbe44 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:47.752490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:47.753146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:47.753409 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:47.753684 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] PATH_INFO: `/v3/projects/fde6480721bf4973bfd2db89c166beb8` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:47.754834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde6480721bf4973bfd2db89c166beb8)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:47.756727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:47.802910 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde6480721bf4973bfd2db89c166beb8', 'request_id': 'req-62e9939e-52bd-463d-81d9-bba4b436a655'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.809159 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde6480721bf4973bfd2db89c166beb8', 'request_id': 'req-62e9939e-52bd-463d-81d9-bba4b436a655'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.816435 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde6480721bf4973bfd2db89c166beb8', 'request_id': 'req-62e9939e-52bd-463d-81d9-bba4b436a655'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.826677 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] The token cache is being invalidate because project fde6480721bf4973bfd2db89c166beb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:47.826963 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.828087 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-62e9939e-52bd-463d-81d9-bba4b436a655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:47.829569 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1384/2783] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:47 2022] DELETE /identity/v3/projects/fde6480721bf4973bfd2db89c166beb8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:58:47.838411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:47.838411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:47.838411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:47.989471 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:47.991476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:48.059931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1400/2784] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:48.067866 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.068150 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.068425 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.088504 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:48.089705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:48.097990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1385/2785] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:58:48.102259 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.111981 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba1ae8-0f97-44a7-92fb-eace24bcd0c6 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.116641 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.117272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.117549 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.118093 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.118817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:58:48.119145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.120976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.133599 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1401/2786] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:58:48.138170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.147829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433788e-b06f-4855-8d09-8661f7baeaf4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.152385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.152975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.153250 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.153520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.154182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.156051 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.182456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1386/2787] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:48.186595 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.197169 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05c670-8538-4000-bb35-f0c5528e4c35 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.235706 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:48.267704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.268221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.268498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.268758 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.269394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.271459 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.294325 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1402/2788] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:48.298534 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.308890 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eef8-e8bf-4227-85a1-b7db66ead34b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.314123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.314727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.315009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.315283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.315924 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.317508 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.328216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1387/2789] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:48.332621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.342542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a49f9-4962-4840-8b18-99f89219a282 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.347318 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.347911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.348184 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.348447 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.349105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.350739 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30691bca-2574-450a-a8d6-3d3e1eee7619 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.361364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1403/2790] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:58:48.365801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.377024 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97a6a-b242-4838-a749-a12eb8716305 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.381729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.382413 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.382695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.382975 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] PATH_INFO: `/v3/projects/abd4301ea656446abf2817cea9a31f7e/users/1768dda7002c4a6bbc0daa472871d874/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.398124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd4301ea656446abf2817cea9a31f7e, user_id=1768dda7002c4a6bbc0daa472871d874, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.400727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.413402 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1388/2791] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:48 2022] PUT /identity/v3/projects/abd4301ea656446abf2817cea9a31f7e/users/1768dda7002c4a6bbc0daa472871d874/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:48.424674 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.424957 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.425225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.453226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] MFA Rules not processed for user `1768dda7002c4a6bbc0daa472871d874`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:48.454453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:48.517448 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1404/2792] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:48.521689 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.530815 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:48.587488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6cb81-443b-418a-bcd2-b5d7f687fa79 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.592276 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.592888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.593199 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.593475 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.594152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.596066 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.623695 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1389/2793] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:48.628406 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.643203 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85abb34-7677-455a-af98-33e791b9aab8 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.700013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.700621 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.700897 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.701165 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.701796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.703827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.724167 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1405/2794] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:48.728186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.738945 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423054a-2a85-47b8-a61c-b0f12291457e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.743876 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.744488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.744773 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.745050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.745710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.747388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.758762 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1390/2795] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:48.762978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.773193 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803a8d-fe91-418b-b9cf-0cfe33c1be52 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.777699 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.778386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.778657 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.778955 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] PATH_INFO: `/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b/users/78b1df8d463d4b3796131c21e276ab0a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.793702 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242d1a2951f4f1cbcca68cc8bf9e05b, user_id=78b1df8d463d4b3796131c21e276ab0a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.797061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.813731 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1406/2796] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:48 2022] PUT /identity/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b/users/78b1df8d463d4b3796131c21e276ab0a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:48.817777 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.827794 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679f9ec-64c6-4879-b6bb-6c28caedb12b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.885956 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.886603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.886907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.887179 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.887818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.889407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf31f-5aa4-4543-9df5-75ee85d9d849 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.899911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1391/2797] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:58:48.903932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:48.914712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8616-fa02-4be5-84f5-063ed9024ef8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:48.919605 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:48.920291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.920564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.920827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] PATH_INFO: `/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b/users/78b1df8d463d4b3796131c21e276ab0a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.923765 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3242d1a2951f4f1cbcca68cc8bf9e05b, user_id=78b1df8d463d4b3796131c21e276ab0a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:48.926565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:48.932438 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:48.939452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1407/2798] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:48 2022] PUT /identity/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b/users/78b1df8d463d4b3796131c21e276ab0a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:48.949719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:48.950001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:48.950306 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:48.979868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] MFA Rules not processed for user `78b1df8d463d4b3796131c21e276ab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:48.981152 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:49.051991 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1392/2799] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:49.063726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:49.065833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:49.139686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3b92f-5b6a-4a04-9e8d-07adbc130d6d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:49.144237 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:49.144862 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:49.145204 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:49.145603 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:49.157242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:49.158914 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:49.169789 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1408/2800] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:49.215733 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:49.217132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:49.225316 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:49.235682 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52b06-b330-46de-ae03-47398b6c4e5f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:49.241206 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:49.241820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:49.242133 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:49.242415 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:49.305078 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:49.307795 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b815d-d22a-4b58-a62b-184f172fd98d service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:49.319898 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1393/2801] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:52.809365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:52.879810 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b75db2-add0-4713-894c-075760688bb7 service cinder] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:52.884418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:52.885044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:52.885321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:52.885590 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] PATH_INFO: `/v3/users/1768dda7002c4a6bbc0daa472871d874` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:52.886770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1768dda7002c4a6bbc0daa472871d874)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:52.888682 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:52.939625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1768dda7002c4a6bbc0daa472871d874'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:52.952159 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1768dda7002c4a6bbc0daa472871d874'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:52.959488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1768dda7002c4a6bbc0daa472871d874'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:52.960212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1768dda7002c4a6bbc0daa472871d874'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:52.967580 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1768dda7002c4a6bbc0daa472871d874'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:52.974715 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1409/2802] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:52 2022] DELETE /identity/v3/users/1768dda7002c4a6bbc0daa472871d874 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:52.979256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:52.979744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:52.979861 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:52.998960 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:53.000165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:53.063272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1394/2803] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:53.073367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:53.075008 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:53.099069 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:53.136226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd09d9-4db5-44ec-880b-fab7ab9171a3 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:53.140480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:53.141079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:53.141353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:53.141620 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:53.150842 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:53.152294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:53.162474 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1410/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:53.444769 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:53.446353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:53.459040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3b03e-966b-43f9-8a8c-474ffd0003a7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:53.464021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:53.464678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:53.464985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:53.465209 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] PATH_INFO: `/v3/projects/abd4301ea656446abf2817cea9a31f7e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:53.466416 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd4301ea656446abf2817cea9a31f7e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:53.468344 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:53.520480 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd4301ea656446abf2817cea9a31f7e', 'request_id': 'req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.527109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd4301ea656446abf2817cea9a31f7e', 'request_id': 'req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.536132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd4301ea656446abf2817cea9a31f7e', 'request_id': 'req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.548268 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] The token cache is being invalidate because project abd4301ea656446abf2817cea9a31f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:53.548578 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.549232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.550746 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1395/2805] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:53 2022] DELETE /identity/v3/projects/abd4301ea656446abf2817cea9a31f7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:53.554965 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:53.565375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48856-1ab5-4158-88b9-8a724f7b4f91 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:53.634849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:53.635670 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:53.635951 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:53.636216 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] PATH_INFO: `/v3/users/78b1df8d463d4b3796131c21e276ab0a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:53.637424 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b1df8d463d4b3796131c21e276ab0a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:53.639370 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:53.692625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b1df8d463d4b3796131c21e276ab0a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.705614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b1df8d463d4b3796131c21e276ab0a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.713004 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b1df8d463d4b3796131c21e276ab0a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.713817 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b1df8d463d4b3796131c21e276ab0a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.721952 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-21182666-4153-4de2-885e-4bc96c34d47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b1df8d463d4b3796131c21e276ab0a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:53.728200 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1411/2806] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:53 2022] DELETE /identity/v3/users/78b1df8d463d4b3796131c21e276ab0a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:54.010589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.013696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:54.034783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b976f-12a2-4dc0-87e3-a0ee8a90ffed admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.057715 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:54.097080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.097630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.097913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.098228 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] PATH_INFO: `/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.099385 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3242d1a2951f4f1cbcca68cc8bf9e05b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.101285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.148766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3242d1a2951f4f1cbcca68cc8bf9e05b', 'request_id': 'req-26f1d56b-568d-4555-8819-1460099003e9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:54.155237 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3242d1a2951f4f1cbcca68cc8bf9e05b', 'request_id': 'req-26f1d56b-568d-4555-8819-1460099003e9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:54.163267 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3242d1a2951f4f1cbcca68cc8bf9e05b', 'request_id': 'req-26f1d56b-568d-4555-8819-1460099003e9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:54.174608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] The token cache is being invalidate because project 3242d1a2951f4f1cbcca68cc8bf9e05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:54.174899 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:54.175543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-26f1d56b-568d-4555-8819-1460099003e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:54.177040 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1396/2807] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:54 2022] DELETE /identity/v3/projects/3242d1a2951f4f1cbcca68cc8bf9e05b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:54.181864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.182368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.182490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.204755 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:54.206205 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:54.246724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:54.268894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1412/2808] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:54.276698 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.277061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.277405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.299021 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:54.300391 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:54.308293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1397/2809] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:54.312574 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.322302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ddc5-1c89-4188-9b06-a04971b87c80 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.326813 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.327403 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.327675 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.327937 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.328573 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:58:54.328864 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.330491 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.342236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1413/2810] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:58:54.347332 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.356547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809f592-7c29-47bf-ada7-24d319798367 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.362213 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.362829 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.363109 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.363378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.364016 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.365912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.394163 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1398/2811] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:54.398409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.409202 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e7f9b-0d84-4ddb-bf9a-aa52a7028f75 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.471869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.472476 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.472756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.473022 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.473653 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.475649 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.499732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1414/2812] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:54.504022 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.514527 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7216e4-de37-4a81-b967-4e451f12adc7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.519999 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.520643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.520879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.521145 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.521786 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.523408 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.534488 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1399/2813] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:54.539075 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.549310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ab9d7-c60f-4580-9f83-29a2451c0564 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.554358 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.554990 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.555266 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.555695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.556339 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.557921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0a4e-2cc5-4e87-94e6-36a85ee119ef admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.570687 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1415/2814] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:54.575290 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.586405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859b9cc-f0bb-4bc2-b35a-0436aafb909a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.594685 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.595349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.595652 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.595928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] PATH_INFO: `/v3/projects/dfdb6f3922ab4983b808578c7bf99bc0/users/3acddd3417f64fb6ba0971d58940cb0a/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.612540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdb6f3922ab4983b808578c7bf99bc0, user_id=3acddd3417f64fb6ba0971d58940cb0a, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.615168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.629532 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1400/2815] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:54 2022] PUT /identity/v3/projects/dfdb6f3922ab4983b808578c7bf99bc0/users/3acddd3417f64fb6ba0971d58940cb0a/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:54.695267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.695522 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.695790 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.726697 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] MFA Rules not processed for user `3acddd3417f64fb6ba0971d58940cb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:54.727918 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:54.794506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1416/2816] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:54.799407 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.856843 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:54.871563 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702bf00-1a50-4e01-9403-73a41235b07f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.878442 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.879288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.879696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.880082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.880818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.882897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:54.911511 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1401/2817] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:54.915880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:54.927402 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d601-019d-416d-8bf7-91de5d9c7ac2 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:54.962594 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:54.987382 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:54.988070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:54.988345 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:54.991224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:54.991942 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:54.994520 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.017948 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1417/2818] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:54 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:55.022037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.034149 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43651487-e14c-46ff-99b1-8cd4cc4b73aa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.039000 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.039623 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.039903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.040175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.040825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.042497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.057873 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1402/2819] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:55.062824 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.073513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979065d-e314-4d9c-954d-0c4c042682c1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.079399 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.080072 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.080351 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.080623 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] PATH_INFO: `/v3/projects/55ce2195ea7a46d6beee302ae447e77a/users/2a7f240b42344cd4a917d5fb9b0a3cf1/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.098086 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce2195ea7a46d6beee302ae447e77a, user_id=2a7f240b42344cd4a917d5fb9b0a3cf1, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.100889 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.114206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1418/2820] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:55 2022] PUT /identity/v3/projects/55ce2195ea7a46d6beee302ae447e77a/users/2a7f240b42344cd4a917d5fb9b0a3cf1/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:55.118990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.131687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b6e3a-59a0-41a3-816b-8c5ba39c61dd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.192123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.192867 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.193247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.193679 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.194464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.196260 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951b6ae-b5df-4678-872e-fab66e48ce4c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.207545 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1403/2821] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:55.212057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.225732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf401d-abba-49a0-ba77-6653b105dafa admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.230396 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.231046 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.231321 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.231588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] PATH_INFO: `/v3/projects/55ce2195ea7a46d6beee302ae447e77a/users/2a7f240b42344cd4a917d5fb9b0a3cf1/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.234000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce2195ea7a46d6beee302ae447e77a, user_id=2a7f240b42344cd4a917d5fb9b0a3cf1, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.236648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.248342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1419/2822] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:55 2022] PUT /identity/v3/projects/55ce2195ea7a46d6beee302ae447e77a/users/2a7f240b42344cd4a917d5fb9b0a3cf1/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:58:55.259233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.259519 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.259797 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.287730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] MFA Rules not processed for user `2a7f240b42344cd4a917d5fb9b0a3cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:55.288952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:55.359754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1404/2823] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:55.371523 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.373292 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:55.432033 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316ca6-dad8-4985-ada4-8a1e7ada15b2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.435692 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.436294 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.438394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.438394 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.446831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.448327 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0efb4-9033-4fdd-b9ad-3f478f868441 service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.457932 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1420/2824] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:55.532333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.580727 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:55.596645 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe2215-ed6a-4b83-aa2d-ec7252a79546 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.601244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.601870 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.602182 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.602456 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] PATH_INFO: `/v3/users/3acddd3417f64fb6ba0971d58940cb0a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.603587 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acddd3417f64fb6ba0971d58940cb0a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.605548 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.653710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acddd3417f64fb6ba0971d58940cb0a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:55.661916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acddd3417f64fb6ba0971d58940cb0a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:55.675994 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acddd3417f64fb6ba0971d58940cb0a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:55.676711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acddd3417f64fb6ba0971d58940cb0a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:55.684826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acddd3417f64fb6ba0971d58940cb0a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:55.691522 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1405/2825] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:55 2022] DELETE /identity/v3/users/3acddd3417f64fb6ba0971d58940cb0a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:55.696226 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.696513 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.696782 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.715829 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:55.717044 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:55.778998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1421/2826] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:55.789243 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:55.790694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:55.849037 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25777440-b529-40f3-8016-b4f3b3391455 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:55.852692 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:55.853307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:55.853580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:55.853849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:55.863834 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:55.865252 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:55.875075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1406/2827] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:56.144610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:56.146276 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:56.160843 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d3d9-3da9-424d-b4f0-441aa54ae1bd None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:56.165550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:56.166224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:56.166496 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:56.166761 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] PATH_INFO: `/v3/projects/dfdb6f3922ab4983b808578c7bf99bc0` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:56.168463 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdb6f3922ab4983b808578c7bf99bc0)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:56.171085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:56.203949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:56.221904 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdb6f3922ab4983b808578c7bf99bc0', 'request_id': 'req-a0ca0274-0d57-46da-b163-0a19cf485f49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.228199 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdb6f3922ab4983b808578c7bf99bc0', 'request_id': 'req-a0ca0274-0d57-46da-b163-0a19cf485f49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.235826 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdb6f3922ab4983b808578c7bf99bc0', 'request_id': 'req-a0ca0274-0d57-46da-b163-0a19cf485f49'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.247017 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] The token cache is being invalidate because project dfdb6f3922ab4983b808578c7bf99bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:56.247328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.247982 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.249489 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1422/2828] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:56 2022] DELETE /identity/v3/projects/dfdb6f3922ab4983b808578c7bf99bc0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:56.253611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:56.263368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e871b-397c-4964-9d1e-75d3c36f87a6 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:56.324310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:56.324942 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:56.325218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:56.325490 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] PATH_INFO: `/v3/users/2a7f240b42344cd4a917d5fb9b0a3cf1` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:56.326654 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7f240b42344cd4a917d5fb9b0a3cf1)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:56.329528 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:56.340258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:56.381916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7f240b42344cd4a917d5fb9b0a3cf1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.389414 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7f240b42344cd4a917d5fb9b0a3cf1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.402912 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7f240b42344cd4a917d5fb9b0a3cf1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.403737 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7f240b42344cd4a917d5fb9b0a3cf1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.411744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9395722f-6a11-450f-b736-1feaf607af15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7f240b42344cd4a917d5fb9b0a3cf1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.418129 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1407/2829] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:56 2022] DELETE /identity/v3/users/2a7f240b42344cd4a917d5fb9b0a3cf1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:56.713338 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:56.714819 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:56.736679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca0274-0d57-46da-b163-0a19cf485f49 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:56.797252 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:56.798319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:56.798319 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:56.798488 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] PATH_INFO: `/v3/projects/55ce2195ea7a46d6beee302ae447e77a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:56.799783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ce2195ea7a46d6beee302ae447e77a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:56.801837 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:56.851974 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ce2195ea7a46d6beee302ae447e77a', 'request_id': 'req-d34f545c-b452-4047-8a6d-edb25fbbd131'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.859112 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ce2195ea7a46d6beee302ae447e77a', 'request_id': 'req-d34f545c-b452-4047-8a6d-edb25fbbd131'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.866967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ce2195ea7a46d6beee302ae447e77a', 'request_id': 'req-d34f545c-b452-4047-8a6d-edb25fbbd131'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.878770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] The token cache is being invalidate because project 55ce2195ea7a46d6beee302ae447e77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:56.879095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.879752 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d34f545c-b452-4047-8a6d-edb25fbbd131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:56.881277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1423/2830] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:56 2022] DELETE /identity/v3/projects/55ce2195ea7a46d6beee302ae447e77a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:56.887308 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:56.887594 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:56.887865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:56.910234 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:56.911495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:56.976314 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1408/2831] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:56.985271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:56.985554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:56.985828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.007372 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:57.008690 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:57.016434 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1424/2832] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:57.020907 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.031696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41900e-ef28-4d4c-93a3-64d092023aa7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.036390 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.037015 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.037327 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.037602 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.038296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:58:57.038600 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.040229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.054943 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1409/2833] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:58:57.059373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.069454 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3575d-8b41-4ff8-a040-dc25445adba3 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.074518 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.075102 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.075376 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.075643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.076273 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.078207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.106786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1425/2834] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:57 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:57.111614 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.124674 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af6e1-582f-4047-82a5-b5739e7c286d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.183776 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.184383 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.184665 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.184933 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.185722 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.187649 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.214174 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1410/2835] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:57 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:57.220663 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.231245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded24e-e802-4ec5-8cfd-49a2860018d1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.236828 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.237427 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.237696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.237963 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.238637 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.240225 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.250943 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1426/2836] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:57.254970 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.261398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:57.265468 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18fbb-7dc0-40ea-8441-7b12b5d55661 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.271299 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.271921 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.272368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.272691 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.273460 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.275373 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134f2b6-47dd-4918-9ad2-3323d4964da2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.287132 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1411/2837] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:57.291248 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.304561 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3339b69-1a6c-4687-9c63-288ea2be526b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.308947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.309659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.309975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.310317 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] PATH_INFO: `/v3/projects/a3e19985d7bf43569ad070b88a20a1b3/users/9f5ffdff95224881b9a54b49b701e4bc/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.312668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:57.327827 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e19985d7bf43569ad070b88a20a1b3, user_id=9f5ffdff95224881b9a54b49b701e4bc, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.330625 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.349999 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1427/2838] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:57 2022] PUT /identity/v3/projects/a3e19985d7bf43569ad070b88a20a1b3/users/9f5ffdff95224881b9a54b49b701e4bc/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:58:57.360713 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.361055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.361266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.389714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] MFA Rules not processed for user `9f5ffdff95224881b9a54b49b701e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:57.390982 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:57.456302 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1412/2839] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:57.495732 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.497461 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:57.556497 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58046c8d-7512-480d-b052-89fd68422def admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.560689 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.561457 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.561863 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.562301 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.571562 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.573000 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512e7d0-b0cc-4a9c-aa14-808c75e4a0eb service cinder] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.582565 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1428/2840] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:57.598232 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.661125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a282a3-07aa-4652-b21a-2b56514d2b60 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.665914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.666580 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.666864 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.667141 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] PATH_INFO: `/v3/users/9f5ffdff95224881b9a54b49b701e4bc` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.668272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5ffdff95224881b9a54b49b701e4bc)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.670261 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.716977 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5ffdff95224881b9a54b49b701e4bc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:57.725520 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5ffdff95224881b9a54b49b701e4bc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:57.738124 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5ffdff95224881b9a54b49b701e4bc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:57.738863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5ffdff95224881b9a54b49b701e4bc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:57.748285 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5ffdff95224881b9a54b49b701e4bc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:57.755426 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1413/2841] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:58:57 2022] DELETE /identity/v3/users/9f5ffdff95224881b9a54b49b701e4bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:57.760492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.760848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.761154 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.781812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:57.783407 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:57.842306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1429/2842] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:57.852854 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:57.854323 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:57.859666 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:57.913042 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6d904-c951-47f3-abd7-16f42fa00f2f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:57.916676 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:57.917277 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:57.917618 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:57.917894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:57.926848 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:57.928258 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77104-c762-4ebf-8064-f3f26b6b96dd service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:57.938227 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1414/2843] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:58:58.204095 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.205887 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:58.221377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3920f-9bef-439e-b384-5a9621594a19 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.226770 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.227409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.227679 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.227987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] PATH_INFO: `/v3/projects/a3e19985d7bf43569ad070b88a20a1b3` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.229163 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e19985d7bf43569ad070b88a20a1b3)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.230987 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.285430 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e19985d7bf43569ad070b88a20a1b3', 'request_id': 'req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:58.291742 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e19985d7bf43569ad070b88a20a1b3', 'request_id': 'req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:58.299684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e19985d7bf43569ad070b88a20a1b3', 'request_id': 'req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:58.310803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] The token cache is being invalidate because project a3e19985d7bf43569ad070b88a20a1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:58:58.311085 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:58.312304 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-7ab5c5a4-0d89-4ec0-8190-73a109abd75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:58:58.313776 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1430/2844] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:58:58 2022] DELETE /identity/v3/projects/a3e19985d7bf43569ad070b88a20a1b3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:58.318865 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.319742 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.319915 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.340097 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:58.341222 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:58.411312 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1415/2845] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:58.419026 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.419302 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.419566 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.439884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:58.441116 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:58.449119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1431/2846] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:58.454047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.463887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656102a1-a608-4a02-9f90-53ed470098cc None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.469218 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.469840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.470147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.470427 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.471082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:58:58.471388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.473001 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.485711 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1416/2847] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:58:58.490214 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.494954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:58.501367 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0cd4-9c91-4dc4-b78b-7a585d1c8a8c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.507187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.507801 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.508104 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.508373 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.509029 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.510985 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.540478 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1432/2848] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:58.544925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.555396 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08410772-b227-4603-be0c-f57d3abd1362 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.613944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.614499 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.614782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.615064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.615719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.617897 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.639538 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1417/2849] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:58.644506 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.654998 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a1ef8-73e2-4937-8438-8b480c97fabe admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.659614 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.660206 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.660481 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.660754 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.661392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.663035 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.672900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1433/2850] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:58.676831 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.687380 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f2ed3-ba8b-4307-96c2-287588752a24 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.692003 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.692608 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.692892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.693169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.693818 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.695443 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed93e9f-4485-4072-aac6-92daa21dc85b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.706610 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1418/2851] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:58.710726 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.720647 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa089-40f7-45a9-b6a0-a69c0c26f7c2 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.725263 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.725900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.726323 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.726483 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] PATH_INFO: `/v3/projects/aa3af974dc584bddaa29057e328f6adc/users/5c34c9c5104545f1b5432ae21b392183/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.740812 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3af974dc584bddaa29057e328f6adc, user_id=5c34c9c5104545f1b5432ae21b392183, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.743780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.756960 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1434/2852] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:58 2022] PUT /identity/v3/projects/aa3af974dc584bddaa29057e328f6adc/users/5c34c9c5104545f1b5432ae21b392183/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:58.769057 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.769340 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.769611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.789336 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:58.797220 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] MFA Rules not processed for user `5c34c9c5104545f1b5432ae21b392183`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:58.798913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:58.865238 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1419/2853] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:58:58.869966 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.933831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a923-b37e-41c5-a557-a9b8207abbef admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:58.939105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:58.939695 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:58.939967 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:58.940233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:58.940882 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:58.942883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:58.968787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1435/2854] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:58:58.972801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:58.983863 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a958f78-5a3a-4d8c-9792-f8937ac06cc7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.038357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.038965 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.039265 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.039550 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.040169 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.042230 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.063730 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1420/2855] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:58:58 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:58:59.067724 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:59.077838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15957343-5c4b-44f9-8d4e-a5cc7fece17c admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.082393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.082975 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.083249 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.083512 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.084140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.085705 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.095984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1436/2856] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:59.100058 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:59.110575 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04d7e-190f-40f9-af73-fcb5804228ad admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.115176 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.115913 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.116123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.116374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] PATH_INFO: `/v3/projects/a63762673b2a48389eaa9fcec896360f/users/916a2183892e45259e39faf3468cfc9a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.134349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63762673b2a48389eaa9fcec896360f, user_id=916a2183892e45259e39faf3468cfc9a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.137044 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.149353 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1421/2857] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:59 2022] PUT /identity/v3/projects/a63762673b2a48389eaa9fcec896360f/users/916a2183892e45259e39faf3468cfc9a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:59.153423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:59.163627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fe3fb-59cc-4f1f-98fe-d6cb23ba49bd admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.219787 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.220596 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.220873 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.221140 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.221773 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.223393 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac970740-2885-433b-91c9-f83d469ac48a admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.233277 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1437/2858] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:58:59.238171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:59.248638 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707a727-ba09-420b-bbfb-d170c8224f46 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.253892 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.254570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.254844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.255112 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] PATH_INFO: `/v3/projects/a63762673b2a48389eaa9fcec896360f/users/916a2183892e45259e39faf3468cfc9a/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.256997 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63762673b2a48389eaa9fcec896360f, user_id=916a2183892e45259e39faf3468cfc9a, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.259619 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.269687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1422/2859] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:58:59 2022] PUT /identity/v3/projects/a63762673b2a48389eaa9fcec896360f/users/916a2183892e45259e39faf3468cfc9a/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:58:59.279628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.279911 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.280183 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.307446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] MFA Rules not processed for user `916a2183892e45259e39faf3468cfc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:58:59.308640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:59.313257 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:59.379855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1438/2860] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:58:59.391487 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:58:59.393183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:58:59.449820 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fcb7e-633a-41fe-9a8f-816876747593 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:58:59.454184 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:58:59.454785 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:58:59.455061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:58:59.455331 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:58:59.460551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:58:59.511716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:58:59.513155 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5a00f-8337-4280-9c72-cf87c1698f0a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:58:59.522743 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1423/2861] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:02.056038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:02.116898 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe55c7-8b9f-444d-9af1-3bca2ce1da20 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:02.121845 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:02.122453 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:02.122750 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:02.123019 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] PATH_INFO: `/v3/users/5c34c9c5104545f1b5432ae21b392183` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:02.124150 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c34c9c5104545f1b5432ae21b392183)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:02.126057 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:02.171392 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c34c9c5104545f1b5432ae21b392183'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.183087 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c34c9c5104545f1b5432ae21b392183'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.190498 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c34c9c5104545f1b5432ae21b392183'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.191371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c34c9c5104545f1b5432ae21b392183'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.200309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c34c9c5104545f1b5432ae21b392183'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.208232 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1439/2862] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:59:02 2022] DELETE /identity/v3/users/5c34c9c5104545f1b5432ae21b392183 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:02.212837 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:02.213342 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:02.213452 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:02.233874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:02.235844 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:02.293690 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1424/2863] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:02.304174 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:02.305602 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:02.328570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:02.366280 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fc48e-d322-4456-9a1e-d8d2e0ff7468 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:02.370425 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:02.370964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:02.371240 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:02.371504 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:02.380976 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:02.382579 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:02.391894 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1440/2864] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:02.673513 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:02.675009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:02.688559 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aadcd-f38e-48d9-aedd-b64c5eec67b7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:02.694177 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:02.695068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:02.695368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:02.695611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] PATH_INFO: `/v3/projects/aa3af974dc584bddaa29057e328f6adc` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:02.696946 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3af974dc584bddaa29057e328f6adc)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:02.698825 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:02.747060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3af974dc584bddaa29057e328f6adc', 'request_id': 'req-3bbea0e4-eeca-4b71-874c-1dfa0933385d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.753814 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3af974dc584bddaa29057e328f6adc', 'request_id': 'req-3bbea0e4-eeca-4b71-874c-1dfa0933385d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.761573 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3af974dc584bddaa29057e328f6adc', 'request_id': 'req-3bbea0e4-eeca-4b71-874c-1dfa0933385d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.771888 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] The token cache is being invalidate because project aa3af974dc584bddaa29057e328f6adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:59:02.772168 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.772772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.774289 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1425/2865] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:59:02 2022] DELETE /identity/v3/projects/aa3af974dc584bddaa29057e328f6adc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:02.778353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:02.787949 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e88820-242b-4325-8ac7-626acd1439de service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:02.843855 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:02.844490 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:02.844764 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:02.845034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] PATH_INFO: `/v3/users/916a2183892e45259e39faf3468cfc9a` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:02.846207 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916a2183892e45259e39faf3468cfc9a)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:02.848115 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:02.894189 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916a2183892e45259e39faf3468cfc9a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.905780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916a2183892e45259e39faf3468cfc9a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.913031 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916a2183892e45259e39faf3468cfc9a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.913700 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916a2183892e45259e39faf3468cfc9a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.921105 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f41699bc-da15-4412-a95d-c70b084605c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916a2183892e45259e39faf3468cfc9a'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:02.927236 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1441/2866] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:59:02 2022] DELETE /identity/v3/users/916a2183892e45259e39faf3468cfc9a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:03.216343 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.217824 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:03.231318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbea0e4-eeca-4b71-874c-1dfa0933385d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.263603 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:03.294164 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.294801 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.295082 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.295354 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] PATH_INFO: `/v3/projects/a63762673b2a48389eaa9fcec896360f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.296554 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63762673b2a48389eaa9fcec896360f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.298495 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.346118 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63762673b2a48389eaa9fcec896360f', 'request_id': 'req-2ea28587-1f81-4fd3-8e88-12bf0544d779'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:03.352496 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63762673b2a48389eaa9fcec896360f', 'request_id': 'req-2ea28587-1f81-4fd3-8e88-12bf0544d779'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:03.360662 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63762673b2a48389eaa9fcec896360f', 'request_id': 'req-2ea28587-1f81-4fd3-8e88-12bf0544d779'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:03.374958 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] The token cache is being invalidate because project a63762673b2a48389eaa9fcec896360f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:59:03.375255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:03.375918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ea28587-1f81-4fd3-8e88-12bf0544d779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:03.377421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1426/2867] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:59:03 2022] DELETE /identity/v3/projects/a63762673b2a48389eaa9fcec896360f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:03.382613 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.383201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.383201 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.402410 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:03.403616 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:03.445108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:03.468390 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1442/2868] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:59:03.476980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.477256 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.477540 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.497754 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:03.499298 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:03.507255 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1427/2869] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:03.511588 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.521891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d523c4-ec7e-4385-8e90-dd8402cbfd3c None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.526542 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.527144 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.527418 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.527685 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.528328 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:59:03.528628 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.530272 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.542640 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1443/2870] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:59:03.547136 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.557900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0b548-d1cb-420e-a961-1313a29dbcd2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.562781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.563378 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.563656 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.563927 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.564552 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.566484 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.597637 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1428/2871] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:59:03 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:59:03.601788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.611912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e30be-c9a9-403d-a260-d31c33d85fb9 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.668049 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.668648 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.668922 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.669190 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.669838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.672384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.693557 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1444/2872] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:59:03 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:59:03.697840 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.708080 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1eece-4a1f-4363-bb04-4f707a3e3c44 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.712980 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.713570 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.713852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.714146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.714783 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.716376 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.726205 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1429/2873] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:59:03.730118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.740525 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6049b-4182-46f3-b5e2-44b0b1c60fa8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.745884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.746541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.746814 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.747081 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.747717 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.749291 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034daf6-b60c-4ed3-9034-6f7728c8bd8d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.760701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1445/2874] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:59:03.764972 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.775338 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e0f6-b298-4a25-9195-4a97f6c615e1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.779914 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.780577 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.780868 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.781766 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] PATH_INFO: `/v3/projects/d51f42c7ca4c40718473b2f0d54c3f87/users/f9dece73850b452282964953c2ae90fb/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.795969 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51f42c7ca4c40718473b2f0d54c3f87, user_id=f9dece73850b452282964953c2ae90fb, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:03.798728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:03.811074 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1430/2875] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:59:03 2022] PUT /identity/v3/projects/d51f42c7ca4c40718473b2f0d54c3f87/users/f9dece73850b452282964953c2ae90fb/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:03.822869 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908d5c-f813-4051-9e43-f828780ebc46 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.823224 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908d5c-f813-4051-9e43-f828780ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.823563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad908d5c-f813-4051-9e43-f828780ebc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:03.852686 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ad908d5c-f813-4051-9e43-f828780ebc46 None None] MFA Rules not processed for user `f9dece73850b452282964953c2ae90fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:03.853885 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ad908d5c-f813-4051-9e43-f828780ebc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:03.915870 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1446/2876] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:03.926971 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:03.928632 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:03.985990 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b441a-0ab3-4b21-a380-e4f3c8406360 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:03.989627 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '273e5c26e347484d84b6b1b196b11282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:03.990266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:03.990551 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:03.990821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:04.000781 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:04.002231 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:04.006918 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:04.012075 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1431/2877] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:05.366851 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e35b-c416-4109-b899-8ce6dfaaeb07 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:05.367389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e35b-c416-4109-b899-8ce6dfaaeb07 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:05.367389 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e35b-c416-4109-b899-8ce6dfaaeb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:05.387128 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-d025e35b-c416-4109-b899-8ce6dfaaeb07 None None] MFA Rules not processed for user `f9dece73850b452282964953c2ae90fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:05.388344 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d025e35b-c416-4109-b899-8ce6dfaaeb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:05.395806 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1447/2878] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:08.691646 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:08.693103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:08.750596 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c427a8-789b-444f-8826-4ebcf91a775a service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:08.754216 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:08.754817 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:08.755094 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:08.755366 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:08.757185 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:08.767628 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:08.768952 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:08.776974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1432/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:15.381681 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:18.773405 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=26 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:20.216541 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c2ca-c65d-49e6-bb9b-48f034c10e43 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:20.217149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c2ca-c65d-49e6-bb9b-48f034c10e43 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:20.217149 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c2ca-c65d-49e6-bb9b-48f034c10e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:20.265660 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-ba80c2ca-c65d-49e6-bb9b-48f034c10e43 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:20.266954 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-ba80c2ca-c65d-49e6-bb9b-48f034c10e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:20.331811 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1448/2880] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:20.381229 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:20.382687 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:20.474515 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b2c5-d77b-480f-8e99-97d59f440e79 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:20.479979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:20.480579 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:20.480857 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:20.481125 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:20.489891 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:20.491503 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:20.500741 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1433/2881] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:59:20.989130 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008e1e-80aa-4978-87dc-a90b47e9fc97 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:20.989411 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008e1e-80aa-4978-87dc-a90b47e9fc97 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:20.989703 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50008e1e-80aa-4978-87dc-a90b47e9fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.008612 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-50008e1e-80aa-4978-87dc-a90b47e9fc97 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:21.009796 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-50008e1e-80aa-4978-87dc-a90b47e9fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:21.017346 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1449/2882] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:21.029154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:21.040225 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c22fa2-5494-48dc-9bb7-40ab93c2c1e9 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:21.045208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:21.045800 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:21.046148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:21.046386 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.060464 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:21.062047 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:21.071247 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1434/2883] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:59:21.283441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26533-4cd6-4a2c-a67d-5a41658281d6 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:21.283931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26533-4cd6-4a2c-a67d-5a41658281d6 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:21.284043 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26533-4cd6-4a2c-a67d-5a41658281d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.302850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-0aa26533-4cd6-4a2c-a67d-5a41658281d6 None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:21.304061 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0aa26533-4cd6-4a2c-a67d-5a41658281d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:21.311181 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1450/2884] 10.222.0.52 () {58 vars in 1009 bytes} [Wed Aug 24 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:21.323485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:21.335183 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f85e-3769-4331-9765-0223f88df884 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:21.340160 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:21.340790 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:21.341065 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:21.341333 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.349266 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:21.350871 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:21.358974 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1435/2885] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:59:21.679090 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:21.679386 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:21.679654 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.698288 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] MFA Rules not processed for user `13727634b06b4eb893941436d7941d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:21.699500 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:21.707084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1451/2886] 10.222.0.52 () {58 vars in 967 bytes} [Wed Aug 24 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:21.719667 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:21.730728 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ea55-0a6a-4323-9337-6a47e08df7a0 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:21.735744 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '486dd7c41a60456892803f8acbb5e36e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:21.736368 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:21.736648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:21.736944 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:21.745365 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:21.746988 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6d688-6828-4348-9421-d63abba4352e service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:21.754782 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1436/2887] 10.222.0.52 () {60 vars in 1384 bytes} [Wed Aug 24 10:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:59:23.843096 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:23.904145 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b647-e1c7-437f-81ed-57853a3032be None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:23.909233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:23.909848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:23.910151 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:23.910423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] PATH_INFO: `/v3/users/f9dece73850b452282964953c2ae90fb` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:23.911546 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dece73850b452282964953c2ae90fb)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:23.913450 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:23.958153 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dece73850b452282964953c2ae90fb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:23.963279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:23.971925 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dece73850b452282964953c2ae90fb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:23.978643 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dece73850b452282964953c2ae90fb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:23.979310 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dece73850b452282964953c2ae90fb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:23.986464 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dece73850b452282964953c2ae90fb'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:23.992733 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1452/2888] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 10:59:23 2022] DELETE /identity/v3/users/f9dece73850b452282964953c2ae90fb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:23.997335 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:23.997809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:23.997911 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.016798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:24.017985 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.076716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1437/2889] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:24.086836 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.088279 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.143921 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95141f-9560-42d2-8070-14b7b7d08fa1 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.147545 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.148134 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.148405 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.148668 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.158371 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.159799 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e40d8-0856-4e02-8e21-acb2bcb7eadb service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.169148 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1453/2890] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:24.335055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.336826 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.349931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9706bdf-7acf-4e8c-96b1-43f06d0807c2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.354938 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.355609 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.355872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.356147 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] PATH_INFO: `/v3/projects/d51f42c7ca4c40718473b2f0d54c3f87` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.357287 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51f42c7ca4c40718473b2f0d54c3f87)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.359928 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.392171 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:24.409251 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51f42c7ca4c40718473b2f0d54c3f87', 'request_id': 'req-1bad01c4-29bd-452e-9961-811485c700b6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:24.415422 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51f42c7ca4c40718473b2f0d54c3f87', 'request_id': 'req-1bad01c4-29bd-452e-9961-811485c700b6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:24.424362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51f42c7ca4c40718473b2f0d54c3f87', 'request_id': 'req-1bad01c4-29bd-452e-9961-811485c700b6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:24.437322 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] The token cache is being invalidate because project d51f42c7ca4c40718473b2f0d54c3f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:59:24.437699 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:24.438387 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1bad01c4-29bd-452e-9961-811485c700b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:59:24.439885 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1438/2891] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 10:59:24 2022] DELETE /identity/v3/projects/d51f42c7ca4c40718473b2f0d54c3f87 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:24.444781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.445070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.445343 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.470335 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:24.471564 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.529517 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1454/2892] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:24.537710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.537979 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.538288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.558592 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:24.559849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.567887 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1439/2893] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:24.572082 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.582364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b4622-13f8-46b0-ae1f-5a6547e31187 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.586978 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.587570 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.587848 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.588117 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.588756 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:59:24.589056 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.590704 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.602701 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1455/2894] 10.222.0.52 () {58 vars in 1153 bytes} [Wed Aug 24 10:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:59:24.606953 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.616635 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15b2ba-40f2-4bca-b869-316b87b6155b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.621459 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.622049 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.622352 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.622622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.623236 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.625678 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.653421 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1440/2895] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:59:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:59:24.658213 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.668298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3642-fe70-4418-acde-31c8c79b30e8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.726482 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.727084 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.727359 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.727635 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.728256 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.730196 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.738907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:24.752575 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1456/2896] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:59:24 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:59:24.756756 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.767809 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f7703-ba48-4193-85a5-6a0119d560d7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.772483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.773103 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.773379 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.773648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.774310 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.775931 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.786283 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1441/2897] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:59:24.790062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.799833 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9dcb1-751d-4ea9-97f3-2b53bc4688d8 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.804362 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.804941 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.805212 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.805475 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.806129 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.807694 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36708e-318c-413c-94a3-c252c27f8214 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.818530 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1457/2898] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:59:24.822694 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.833050 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a7680-6ae0-4069-9958-b5695c0a58b9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:24.837611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:24.838295 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.838576 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.838849 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] PATH_INFO: `/v3/projects/11203f4afd80436bb75acd58ca7fb2c2/users/56528f33621145b2ac28fba72637343d/roles/266f2149c31e44dbae08f90e49f8ce15` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.853732 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11203f4afd80436bb75acd58ca7fb2c2, user_id=56528f33621145b2ac28fba72637343d, role_id=266f2149c31e44dbae08f90e49f8ce15)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:24.856398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:24.869062 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1442/2899] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:59:24 2022] PUT /identity/v3/projects/11203f4afd80436bb75acd58ca7fb2c2/users/56528f33621145b2ac28fba72637343d/roles/266f2149c31e44dbae08f90e49f8ce15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:24.874062 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a458-e6fb-4830-b04b-4c499e07e8fe None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:24.874550 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a458-e6fb-4830-b04b-4c499e07e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:24.874666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a458-e6fb-4830-b04b-4c499e07e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:24.894178 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-3057a458-e6fb-4830-b04b-4c499e07e8fe None None] MFA Rules not processed for user `db44673f0e0b4e638e97d470584da9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:24.895375 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-3057a458-e6fb-4830-b04b-4c499e07e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:24.954038 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1458/2900] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:24.963658 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:24.965388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:25.023240 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a565cd-b73f-462c-accf-954575cad569 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:25.026934 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:25.027543 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:25.027821 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:25.028095 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:25.037233 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:25.038697 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:25.048128 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1443/2901] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:29.101683 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.102350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.102350 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.138423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] MFA Rules not processed for user `56528f33621145b2ac28fba72637343d`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:29.139928 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:29.215610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1459/2902] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:29.220167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.229987 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b9d08-b1d1-413b-a760-9772393538cc service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.235360 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.235992 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.236272 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.236547 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.237186 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.239275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.269307 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1444/2903] 10.222.0.52 () {60 vars in 1153 bytes} [Wed Aug 24 10:59:29 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:59:29.273492 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.284342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c8c0d-7b27-4466-ba91-b790dcf3c034 None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.341306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.341984 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.342286 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.342551 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] PATH_INFO: `/v3/users` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.343187 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.345627 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.363577 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:29.369970 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1460/2904] 10.222.0.52 () {60 vars in 1144 bytes} [Wed Aug 24 10:59:29 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:59:29.373757 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.384122 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907011c-49ed-4233-a940-e0d2a5b6e0f1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.388611 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.389202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.389497 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.389767 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.390434 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.392009 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.403349 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1445/2905] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 10:59:29.408076 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.418097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b4710-f1af-451a-bf04-ff446998fc2b admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.423245 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.424034 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.424306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.424567 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] PATH_INFO: `/v3/projects/e653d78551e045df834f7fa793b12260/users/a523f10efe34471faec35dbfe95634af/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.439423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e653d78551e045df834f7fa793b12260, user_id=a523f10efe34471faec35dbfe95634af, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.442025 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.456012 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1461/2906] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:59:29 2022] PUT /identity/v3/projects/e653d78551e045df834f7fa793b12260/users/a523f10efe34471faec35dbfe95634af/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:29.460202 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.471384 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141f40b-46a7-457c-ac7b-75d1279240c2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.487909 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:29.528023 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.528625 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.528900 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.529166 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.529798 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.531925 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a047a-a984-4203-907f-4a348f9f682e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.541517 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1446/2907] 10.222.0.52 () {58 vars in 1122 bytes} [Wed Aug 24 10:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:59:29.545741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:29.557306 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79675bfc-8fd3-40d9-ad17-2352a307186e admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:29.562097 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:29.562779 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] REQUEST_METHOD: `PUT` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:29.563045 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:29.563309 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] PATH_INFO: `/v3/projects/e653d78551e045df834f7fa793b12260/users/a523f10efe34471faec35dbfe95634af/roles/88421fc218124abeb809266ecb9668ea` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:29.565188 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e653d78551e045df834f7fa793b12260, user_id=a523f10efe34471faec35dbfe95634af, role_id=88421fc218124abeb809266ecb9668ea)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:29.567874 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:29.579215 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1462/2908] 10.222.0.52 () {60 vars in 1483 bytes} [Wed Aug 24 10:59:29 2022] PUT /identity/v3/projects/e653d78551e045df834f7fa793b12260/users/a523f10efe34471faec35dbfe95634af/roles/88421fc218124abeb809266ecb9668ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:59:33.835440 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c4b-f078-4acc-adb3-2f9374e80620 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:33.836318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c4b-f078-4acc-adb3-2f9374e80620 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:33.836601 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c4c4b-f078-4acc-adb3-2f9374e80620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:33.874412 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-528c4c4b-f078-4acc-adb3-2f9374e80620 None None] MFA Rules not processed for user `a523f10efe34471faec35dbfe95634af`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:33.875696 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-528c4c4b-f078-4acc-adb3-2f9374e80620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:33.964842 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1447/2909] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:59:33.974743 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:33.976563 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:34.080936 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9cfd0-9098-43e9-9398-286508d9093d admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:34.087146 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:34.087781 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:34.088054 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:34.088364 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:34.162947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:34.164839 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:34.178684 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1463/2910] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:35.232894 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:35.233350 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:35.233493 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:35.253771 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] MFA Rules not processed for user `56528f33621145b2ac28fba72637343d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:59:35.255005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:35.267791 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1448/2911] 10.222.0.52 () {58 vars in 958 bytes} [Wed Aug 24 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:59:44.170311 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:45.247734 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=57 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:59:52.928441 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:52.929884 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:52.986108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b6338-1e95-4b81-8b21-9a6ed38e599f service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:52.989944 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:52.990576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:52.990852 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:52.991119 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:52.993118 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:53.002830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:53.004255 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:53.012446 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1464/2912] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:54.458852 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:59:54.460370 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:54.529879 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597da5b-504c-4083-a59a-7de659d8904b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:59:54.534874 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:59:54.535483 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:59:54.535763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:59:54.536053 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:59:54.537779 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:59:54.550061 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:59:54.551669 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:59:54.564292 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1449/2913] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:59:59.997913 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:00:00.017672 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424eecc-7cde-4886-a994-08c4eed501f0 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:00:00.024878 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:00:00.025508 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:00:00.025786 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:00:00.026109 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:00:00.028368 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:00:00.046039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:00:00.047856 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:00:00.060774 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1465/2914] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 10:59:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:04.558701 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=32 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:06.412729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:00:06.415028 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:00:06.437607 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a170-b9a1-4d21-ad8d-f05db8107bc5 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:00:06.444068 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:00:06.444729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:00:06.445013 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:00:06.445622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:00:06.447235 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:00:06.461916 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:00:06.464591 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:00:06.480362 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1450/2915] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:00:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:09.234108 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:00:09.245452 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7552af-6d13-4dc9-912a-75cadfd54be2 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:00:09.249039 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:00:09.249629 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:00:09.250265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:00:09.250265 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:00:09.259734 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:00:09.261166 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:00:09.271576 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1466/2916] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:00:16.476170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:00:19.267409 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=38 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:13.460922 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:02:13.522588 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63d0c3-4aeb-4f8c-9f5a-d6e28fd1ddbf service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:02:13.528686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:02:13.529284 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:13.529567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:13.529841 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:13.531629 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:02:13.563731 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:02:13.565293 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ea1d9-4b66-403e-b835-84d7dfc7259b service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:02:13.575668 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1451/2917] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:02:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:02:23.570903 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=36 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:02:50.178527 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:02:50.197384 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f6b9d-ee2b-467f-978f-17013712bf86 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:02:50.201139 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:02:50.201738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.202013 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.202316 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.204052 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:02:50.214445 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:02:50.215879 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9dca19-015f-43c0-9fcd-02f509d258dd service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:02:50.224342 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1467/2918] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:02:50.352309 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0949b-4710-442c-b375-2b2945e6bafd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.353027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0949b-4710-442c-b375-2b2945e6bafd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.353027 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0949b-4710-442c-b375-2b2945e6bafd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.354630 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1452/2919] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 11:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:02:50.361271 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706a7e-24b6-47a3-9726-46da972bd283 None None] REQUEST_METHOD: `POST` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.361996 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706a7e-24b6-47a3-9726-46da972bd283 None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.362307 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36706a7e-24b6-47a3-9726-46da972bd283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.431377 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.auth.core [None req-36706a7e-24b6-47a3-9726-46da972bd283 None None] MFA Rules not processed for user `479086935d3f440599d314c210cdb44a`. Rule list: `[]` (Enabled: `True`). {{(pid=81676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:02:50.432712 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-36706a7e-24b6-47a3-9726-46da972bd283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:02:50.440912 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1468/2920] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:02:50.455212 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0949b-4710-442c-b375-2b2945e6bafd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:02:50.469318 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0949b-4710-442c-b375-2b2945e6bafd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:02:50.477374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:02:50.477374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.477374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.477374 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.483208 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:02:50.484778 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ebe2-faf4-4e9d-b74f-a6bb82b8367c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:02:50.494437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1453/2921] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:02:50.582741 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8a9c-8c73-4ba2-80e0-6111cf89e67b None None] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.583007 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8a9c-8c73-4ba2-80e0-6111cf89e67b None None] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.583274 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8a9c-8c73-4ba2-80e0-6111cf89e67b None None] PATH_INFO: `/` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.584652 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1469/2922] 10.222.0.52 () {54 vars in 921 bytes} [Wed Aug 24 11:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 11:02:50.589772 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.590054 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.590358 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.641151 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] MFA Rules not processed for user `f3a5ff3f106248c4ae80b6bc74e0d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 11:02:50.643046 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:02:50.669705 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1454/2923] 10.222.0.52 () {58 vars in 1018 bytes} [Wed Aug 24 11:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 11:02:50.681100 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8a9c-8c73-4ba2-80e0-6111cf89e67b None None] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:02:50.692298 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8a9c-8c73-4ba2-80e0-6111cf89e67b None None] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:02:50.695831 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:02:50.696423 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:02:50.696696 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:02:50.696961 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:02:50.707233 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:02:50.708659 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:02:50.720772 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1470/2924] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:03:00.666725 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=27 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:03:00.714964 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=34 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:16.129294 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:16.149462 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af70ad-8c1e-49ad-a4f3-a596c1e0a8c5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:16.153064 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:16.153672 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:16.153947 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:16.154249 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:16.156005 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:16.179653 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:16.181146 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:16.190398 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1455/2925] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:26.185930 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=15 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:32.974714 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:33.001915 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7427-5236-42af-a411-272e4ca83a65 service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:33.013158 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3a5ff3f106248c4ae80b6bc74e0d8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:33.014268 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:33.014666 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:33.015300 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:33.032778 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:33.035880 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:33.058548 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1471/2926] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:33.157428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:33.172648 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec9820-4c53-41c4-b60d-1eaf041baa98 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:33.179716 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:33.180860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:33.181388 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:33.181906 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:33.185948 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:33.213123 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:33.216485 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:33.240045 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1456/2927] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:34.527429 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:34.539234 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd124c4-defa-408e-b382-45f060820d25 service nova] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:34.543157 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:34.543788 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:34.544070 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:34.544348 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:34.546554 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:34.562493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:34.564003 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:34.576900 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1472/2928] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:37.181175 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:37.197264 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1e73a-1c23-4a7f-b5a1-9627550175bf service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:37.201710 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '479086935d3f440599d314c210cdb44a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:37.202444 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:37.202763 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:37.203170 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:37.294984 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:37.296643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:37.320553 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1457/2929] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:41.275365 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:41.277803 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:41.303830 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95d7c-82a6-464d-813f-40ffb7eb912c service neutron] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:41.312891 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:41.314353 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] REQUEST_METHOD: `GET` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:41.314849 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:41.315337 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:41.318947 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:41.342218 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:41.345152 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:41.365079 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1473/2930] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:04:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 11:04:45.667411 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:45.683167 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469541f-64a2-46e0-b75c-a2ab126239c9 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:45.688989 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:45.689567 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:45.689846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:45.690148 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] PATH_INFO: `/v3/users/56528f33621145b2ac28fba72637343d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:45.691392 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56528f33621145b2ac28fba72637343d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:45.693686 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:45.770244 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56528f33621145b2ac28fba72637343d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:45.779472 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56528f33621145b2ac28fba72637343d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:45.795154 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56528f33621145b2ac28fba72637343d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:45.796084 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56528f33621145b2ac28fba72637343d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:45.809437 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56528f33621145b2ac28fba72637343d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:45.817714 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1458/2931] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 11:04:45 2022] DELETE /identity/v3/users/56528f33621145b2ac28fba72637343d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:04:46.090610 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:46.104850 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13827888-0d95-4c28-9c99-326b1c2c100a service placement] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:46.191242 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:46.191883 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:46.192155 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:46.192421 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] PATH_INFO: `/v3/projects/11203f4afd80436bb75acd58ca7fb2c2` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:46.193669 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11203f4afd80436bb75acd58ca7fb2c2)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:46.196103 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:46.258886 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11203f4afd80436bb75acd58ca7fb2c2', 'request_id': 'req-53b8e6c5-eed0-47fc-8160-418b6f7294b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.267780 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11203f4afd80436bb75acd58ca7fb2c2', 'request_id': 'req-53b8e6c5-eed0-47fc-8160-418b6f7294b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.277267 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11203f4afd80436bb75acd58ca7fb2c2', 'request_id': 'req-53b8e6c5-eed0-47fc-8160-418b6f7294b5'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.315192 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] The token cache is being invalidate because project 11203f4afd80436bb75acd58ca7fb2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:04:46.315480 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.316334 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.317907 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1474/2932] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 11:04:46 2022] DELETE /identity/v3/projects/11203f4afd80436bb75acd58ca7fb2c2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:04:46.322643 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:46.324846 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:46.346644 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46f016-0a4a-4137-8d28-f2b648612423 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:46.389920 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:46.424745 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:46.425509 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:46.425872 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:46.426275 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] PATH_INFO: `/v3/users/a523f10efe34471faec35dbfe95634af` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:46.428060 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a523f10efe34471faec35dbfe95634af)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:46.430288 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:46.493919 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a523f10efe34471faec35dbfe95634af'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.504458 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a523f10efe34471faec35dbfe95634af'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.522165 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a523f10efe34471faec35dbfe95634af'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.523055 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a523f10efe34471faec35dbfe95634af'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.533589 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a523f10efe34471faec35dbfe95634af'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.544280 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1459/2933] 10.222.0.52 () {58 vars in 1224 bytes} [Wed Aug 24 11:04:46 2022] DELETE /identity/v3/users/a523f10efe34471faec35dbfe95634af => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:04:46.766638 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Authenticating user token {{(pid=81676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:04:46.768838 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.fernet_utils [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:04:46.796260 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8e6c5-eed0-47fc-8160-418b6f7294b5 admin admin] Validating token access rules against request {{(pid=81676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:04:46.874493 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:46.904835 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db44673f0e0b4e638e97d470584da9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4732e69892d041d9ae3567e9b16b15ff', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:04:46.905931 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:04:46.906408 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:04:46.906901 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] PATH_INFO: `/v3/projects/e653d78551e045df834f7fa793b12260` {{(pid=81676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:04:46.908853 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e653d78551e045df834f7fa793b12260)` {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:04:46.912388 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] RBAC: Authorization granted {{(pid=81676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:04:46.979631 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e653d78551e045df834f7fa793b12260', 'request_id': 'req-f9b4fbb8-747e-4082-a758-57c383cc7127'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.987552 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e653d78551e045df834f7fa793b12260', 'request_id': 'req-f9b4fbb8-747e-4082-a758-57c383cc7127'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:46.997322 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e653d78551e045df834f7fa793b12260', 'request_id': 'req-f9b4fbb8-747e-4082-a758-57c383cc7127'} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:47.011485 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] The token cache is being invalidate because project e653d78551e045df834f7fa793b12260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 11:04:47.011783 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:47.012519 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG keystone.notifications [None req-f9b4fbb8-747e-4082-a758-57c383cc7127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 11:04:47.014221 dv-cinder-854275-3-smb devstack@keystone.service[81676]: [pid: 81676|app: 0|req: 1475/2934] 10.222.0.52 () {58 vars in 1233 bytes} [Wed Aug 24 11:04:46 2022] DELETE /identity/v3/projects/e653d78551e045df834f7fa793b12260 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 11:04:56.537428 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:04:57.007738 dv-cinder-854275-3-smb devstack@keystone.service[81676]: DEBUG dbcounter [-] [81676] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:07:17.481291 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 11:07:17.482860 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:07:17.564029 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb377-23b8-4f60-90de-276fcf644238 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 11:07:17.634474 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e44512af18d47dcbd8f876b35dcb6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da9eea19cea458a839d63b3b31ba1d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 11:07:17.635357 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 11:07:17.635729 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 11:07:17.636108 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 11:07:17.638296 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 11:07:17.652070 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 11:07:17.653719 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38809e-1f0a-478d-b6f5-aee251bbe469 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 11:07:17.665622 dv-cinder-854275-3-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1460/2935] 10.222.0.52 () {60 vars in 1365 bytes} [Wed Aug 24 11:07:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 11:07:27.660192 dv-cinder-854275-3-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=58 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}